__ __ / \ / \ ______ _ _ __ __ __ / /\ / /\ \ / __ \ | | | | / \ \ \ / / / / / / \ \ | | | | | | | | / /\ \ \ / \ \ \ \ / / | |__| | | |__| | / ____ \ | | \ \/ \ \/ / \_ ___/ \____/ /_/ \_\ |_| \__/ \__/ \ \__ \___\ by Red Hat Build, Store, and Distribute your Containers Running all default registry services Running init script '/quay-registry/conf/init/certs_create.sh' Running init script '/quay-registry/conf/init/certs_install.sh' Running init script '/quay-registry/conf/init/copy_config_files.sh' Running init script '/quay-registry/conf/init/d_validate_config_bundle.sh' Validating Configuration time="2022-05-05T11:01:28Z" level=debug msg="Validating AccessSettings" time="2022-05-05T11:01:28Z" level=debug msg="Validating ActionLogArchiving" time="2022-05-05T11:01:28Z" level=debug msg="Validating AppTokenAuthentication" time="2022-05-05T11:01:28Z" level=debug msg="Validating BitbucketBuildTrigger" time="2022-05-05T11:01:28Z" level=debug msg="Validating BuildManager" time="2022-05-05T11:01:28Z" level=debug msg="Validating Database" time="2022-05-05T11:01:28Z" level=debug msg="Scheme: postgresql" time="2022-05-05T11:01:28Z" level=debug msg="Host: 10.0.0.4" time="2022-05-05T11:01:28Z" level=debug msg="Db: quay" time="2022-05-05T11:01:28Z" level=debug msg="Params: " time="2022-05-05T11:01:28Z" level=debug msg="Including params " time="2022-05-05T11:01:28Z" level=debug msg="Pinging database at postgresql://ibazulic:test123@10.0.0.4/quay" plpgsql pg_trgm time="2022-05-05T11:01:28Z" level=debug msg="Validating DistributedStorage" time="2022-05-05T11:01:28Z" level=debug msg="Validating ElasticSearch" time="2022-05-05T11:01:28Z" level=debug msg="Validating Email" time="2022-05-05T11:01:28Z" level=debug msg="Validating GitHubBuildTrigger" time="2022-05-05T11:01:28Z" level=debug msg="Validating GitHubLogin" time="2022-05-05T11:01:28Z" level=debug msg="Validating GitLabBuildTrigger" time="2022-05-05T11:01:28Z" level=debug msg="Validating GoogleLogin" time="2022-05-05T11:01:28Z" level=debug msg="Validating HostSettings" time="2022-05-05T11:01:28Z" level=debug msg="Validating JWTAuthentication" time="2022-05-05T11:01:28Z" level=debug msg="Validating LDAP" time="2022-05-05T11:01:28Z" level=debug msg="Validating OIDC" time="2022-05-05T11:01:28Z" level=debug msg="Validating QuayDocumentation" time="2022-05-05T11:01:28Z" level=debug msg="Validating Redis" time="2022-05-05T11:01:28Z" level=debug msg="Address: 10.0.0.4:6379" time="2022-05-05T11:01:28Z" level=debug msg="Username: " time="2022-05-05T11:01:28Z" level=debug msg="Password Len: 0" time="2022-05-05T11:01:28Z" level=debug msg="Ssl: " time="2022-05-05T11:01:28Z" level=debug msg="Address: 10.0.0.4:6379" time="2022-05-05T11:01:28Z" level=debug msg="Username: " time="2022-05-05T11:01:28Z" level=debug msg="Password Len: 0" time="2022-05-05T11:01:28Z" level=debug msg="Ssl: " time="2022-05-05T11:01:28Z" level=debug msg="Validating RepoMirror" time="2022-05-05T11:01:28Z" level=debug msg="Validating SecurityScanner" time="2022-05-05T11:01:28Z" level=debug msg="Validating TeamSyncing" time="2022-05-05T11:01:28Z" level=debug msg="Validating TimeMachine" time="2022-05-05T11:01:28Z" level=debug msg="Validating UserVisibleSettings" +------------------------+-------+--------+ | Field Group | Error | Status | +------------------------+-------+--------+ | AccessSettings | - | 🟢 | +------------------------+-------+--------+ | ActionLogArchiving | - | 🟢 | +------------------------+-------+--------+ | AppTokenAuthentication | - | 🟢 | +------------------------+-------+--------+ | BitbucketBuildTrigger | - | 🟢 | +------------------------+-------+--------+ | BuildManager | - | 🟢 | +------------------------+-------+--------+ | Database | - | 🟢 | +------------------------+-------+--------+ | DistributedStorage | - | 🟢 | +------------------------+-------+--------+ | ElasticSearch | - | 🟢 | +------------------------+-------+--------+ | Email | - | 🟢 | +------------------------+-------+--------+ | GitHubBuildTrigger | - | 🟢 | +------------------------+-------+--------+ | GitHubLogin | - | 🟢 | +------------------------+-------+--------+ | GitLabBuildTrigger | - | 🟢 | +------------------------+-------+--------+ | GoogleLogin | - | 🟢 | +------------------------+-------+--------+ | HostSettings | - | 🟢 | +------------------------+-------+--------+ | JWTAuthentication | - | 🟢 | +------------------------+-------+--------+ | LDAP | - | 🟢 | +------------------------+-------+--------+ | OIDC | - | 🟢 | +------------------------+-------+--------+ | QuayDocumentation | - | 🟢 | +------------------------+-------+--------+ | Redis | - | 🟢 | +------------------------+-------+--------+ | RepoMirror | - | 🟢 | +------------------------+-------+--------+ | SecurityScanner | - | 🟢 | +------------------------+-------+--------+ | TeamSyncing | - | 🟢 | +------------------------+-------+--------+ | TimeMachine | - | 🟢 | +------------------------+-------+--------+ | UserVisibleSettings | - | 🟢 | +------------------------+-------+--------+ Running init script '/quay-registry/conf/init/nginx_conf_create.sh' Running init script '/quay-registry/conf/init/runmigration.sh' Running init script '/quay-registry/conf/init/supervisord_conf_create.sh' Running init script '/quay-registry/conf/init/zz_boot.sh' 2022-05-05 11:01:43,714 INFO RPC interface 'supervisor' initialized 2022-05-05 11:01:43,714 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2022-05-05 11:01:43,714 INFO supervisord started with pid 7 2022-05-05 11:01:44,717 INFO spawned: 'stdout' with pid 60 2022-05-05 11:01:44,721 INFO spawned: 'blobuploadcleanupworker' with pid 61 2022-05-05 11:01:44,723 INFO spawned: 'builder' with pid 62 2022-05-05 11:01:44,726 INFO spawned: 'buildlogsarchiver' with pid 63 2022-05-05 11:01:44,730 INFO spawned: 'chunkcleanupworker' with pid 64 2022-05-05 11:01:44,732 INFO spawned: 'dnsmasq' with pid 65 2022-05-05 11:01:44,735 INFO spawned: 'expiredappspecifictokenworker' with pid 66 2022-05-05 11:01:44,739 INFO spawned: 'exportactionlogsworker' with pid 67 2022-05-05 11:01:44,742 INFO spawned: 'gcworker' with pid 68 2022-05-05 11:01:44,745 INFO spawned: 'globalpromstats' with pid 69 2022-05-05 11:01:44,748 INFO spawned: 'gunicorn-registry' with pid 70 2022-05-05 11:01:44,751 INFO spawned: 'gunicorn-secscan' with pid 71 2022-05-05 11:01:44,755 INFO spawned: 'gunicorn-web' with pid 72 2022-05-05 11:01:44,766 INFO spawned: 'jwtproxy' with pid 73 2022-05-05 11:01:44,774 INFO spawned: 'logrotateworker' with pid 74 2022-05-05 11:01:44,779 INFO spawned: 'manifestbackfillworker' with pid 75 2022-05-05 11:01:44,792 INFO spawned: 'memcache' with pid 76 2022-05-05 11:01:44,795 INFO spawned: 'namespacegcworker' with pid 80 2022-05-05 11:01:44,802 INFO spawned: 'nginx' with pid 82 2022-05-05 11:01:44,816 INFO spawned: 'notificationworker' with pid 84 2022-05-05 11:01:44,819 INFO spawned: 'pushgateway' with pid 88 2022-05-05 11:01:44,856 INFO spawned: 'queuecleanupworker' with pid 98 2022-05-05 11:01:44,867 INFO spawned: 'repositoryactioncounter' with pid 102 2022-05-05 11:01:44,886 INFO spawned: 'repositorygcworker' with pid 104 2022-05-05 11:01:44,909 INFO spawned: 'securityscanningnotificationworker' with pid 106 2022-05-05 11:01:44,919 INFO spawned: 'securityworker' with pid 107 2022-05-05 11:01:44,937 INFO spawned: 'servicekey' with pid 114 2022-05-05 11:01:44,959 INFO spawned: 'storagereplication' with pid 115 2022-05-05 11:01:44,983 INFO spawned: 'teamsyncworker' with pid 117 2022-05-05 11:01:46,006 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,006 INFO success: blobuploadcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,007 INFO success: builder entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,007 INFO success: buildlogsarchiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,007 INFO success: chunkcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,008 INFO success: dnsmasq entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,008 INFO success: expiredappspecifictokenworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,008 INFO success: exportactionlogsworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,009 INFO success: gcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,009 INFO success: globalpromstats entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,009 INFO success: gunicorn-registry entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,010 INFO success: gunicorn-secscan entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,010 INFO success: gunicorn-web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,010 INFO success: jwtproxy entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,010 INFO success: logrotateworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,011 INFO success: manifestbackfillworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,011 INFO success: memcache entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,011 INFO success: namespacegcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,012 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,012 INFO success: notificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,012 INFO success: pushgateway entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,012 INFO success: queuecleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,013 INFO success: repositoryactioncounter entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,013 INFO success: repositorygcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,013 INFO success: securityscanningnotificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,013 INFO success: securityworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,014 INFO success: servicekey entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,014 INFO success: storagereplication entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2022-05-05 11:01:46,014 INFO success: teamsyncworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) dnsmasq stderr | dnsmasq: started, version 2.79 cachesize 150 dnsmasq stderr | dnsmasq: compile time options: IPv6 GNU-getopt DBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth DNSSEC loop-detect inotify dnsmasq stderr | dnsmasq: reading /etc/resolv.conf dnsmasq stderr | dnsmasq: using nameserver 168.63.129.16#53 dnsmasq stderr | dnsmasq: read /etc/hosts - 7 addresses jwtproxy stderr | time="2022-05-05T11:01:44Z" level=info msg="No claims verifiers specified, upstream should be configured to verify authorization" jwtproxy stderr | time="2022-05-05T11:01:44Z" level=info msg="Starting reverse proxy (Listening on 'unix:/tmp/jwtproxy_secscan.sock')" jwtproxy stderr | time="2022-05-05T11:01:44Z" level=info msg="Starting forward proxy (Listening on ':8081')" nginx stdout | 2022/05/05 11:01:44 [alert] 113#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2022/05/05 11:01:44 [alert] 111#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2022/05/05 11:01:44 [alert] 110#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2022/05/05 11:01:44 [alert] 112#0: setpriority(-10) failed (13: Permission denied) pushgateway stderr | level=info ts=2022-05-05T11:01:44.925Z caller=main.go:85 msg="starting pushgateway" version="(version=, branch=, revision=)" pushgateway stderr | level=info ts=2022-05-05T11:01:44.925Z caller=main.go:86 build_context="(go=go1.15.14, user=, date=)" pushgateway stderr | level=info ts=2022-05-05T11:01:44.932Z caller=main.go:139 listen_address=:9091 pushgateway stderr | level=info ts=2022-05-05T11:01:44.932Z caller=tls_config.go:191 msg="TLS is disabled." http2=false gunicorn-secscan stdout | 2022-05-05 11:01:52,950 [71] [INFO] [data.registry_model] =============================== gunicorn-secscan stdout | 2022-05-05 11:01:52,964 [71] [INFO] [data.registry_model] Using registry model `` gunicorn-secscan stdout | 2022-05-05 11:01:52,966 [71] [INFO] [data.registry_model] =============================== gunicorn-web stdout | 2022-05-05 11:01:53,172 [72] [INFO] [data.registry_model] =============================== gunicorn-web stdout | 2022-05-05 11:01:53,172 [72] [INFO] [data.registry_model] Using registry model `` gunicorn-web stdout | 2022-05-05 11:01:53,173 [72] [INFO] [data.registry_model] =============================== gunicorn-secscan stdout | 2022-05-05 11:01:54,165 [71] [DEBUG] [app] Loading default config. gunicorn-secscan stdout | 2022-05-05 11:01:54,170 [71] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml gunicorn-secscan stdout | 2022-05-05 11:01:54,245 [71] [DEBUG] [app] Loaded config gunicorn-web stdout | 2022-05-05 11:01:54,245 [72] [DEBUG] [app] Loading default config. gunicorn-web stdout | 2022-05-05 11:01:54,245 [72] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml gunicorn-secscan stdout | 2022-05-05 11:01:54,252 [71] [INFO] [util.ipresolver] Loading AWS IP ranges from disk gunicorn-web stdout | 2022-05-05 11:01:54,302 [72] [DEBUG] [app] Loaded config gunicorn-web stdout | 2022-05-05 11:01:54,303 [72] [INFO] [util.ipresolver] Loading AWS IP ranges from disk gunicorn-secscan stdout | 2022-05-05 11:01:54,326 [71] [DEBUG] [util.ipresolver] Building AWS IP ranges gunicorn-web stdout | 2022-05-05 11:01:54,396 [72] [DEBUG] [util.ipresolver] Building AWS IP ranges logrotateworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) logrotateworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) logrotateworker stderr | Failed to validate security scanner V2 configuration logrotateworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) logrotateworker stderr | self._legacy_model = NoopV2SecurityScanner() securityscanningnotificationworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) securityscanningnotificationworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) securityscanningnotificationworker stderr | Failed to validate security scanner V2 configuration securityscanningnotificationworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) securityscanningnotificationworker stderr | self._legacy_model = NoopV2SecurityScanner() blobuploadcleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) blobuploadcleanupworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) blobuploadcleanupworker stderr | Failed to validate security scanner V2 configuration blobuploadcleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) blobuploadcleanupworker stderr | self._legacy_model = NoopV2SecurityScanner() logrotateworker stdout | 2022-05-05 11:01:57,540 [74] [DEBUG] [__main__] Action log rotation worker not enabled; skipping teamsyncworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) teamsyncworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) buildlogsarchiver stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) buildlogsarchiver stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) buildlogsarchiver stderr | Failed to validate security scanner V2 configuration buildlogsarchiver stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) buildlogsarchiver stderr | self._legacy_model = NoopV2SecurityScanner() teamsyncworker stderr | Failed to validate security scanner V2 configuration teamsyncworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) teamsyncworker stderr | self._legacy_model = NoopV2SecurityScanner() securityworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) securityworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) securityworker stderr | Failed to validate security scanner V2 configuration securityworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) securityworker stderr | self._legacy_model = NoopV2SecurityScanner() manifestbackfillworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) manifestbackfillworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) manifestbackfillworker stderr | Failed to validate security scanner V2 configuration manifestbackfillworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) manifestbackfillworker stderr | self._legacy_model = NoopV2SecurityScanner() exportactionlogsworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) exportactionlogsworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) exportactionlogsworker stderr | Failed to validate security scanner V2 configuration exportactionlogsworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) exportactionlogsworker stderr | self._legacy_model = NoopV2SecurityScanner() globalpromstats stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) globalpromstats stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) globalpromstats stderr | Failed to validate security scanner V2 configuration globalpromstats stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) globalpromstats stderr | self._legacy_model = NoopV2SecurityScanner() queuecleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) queuecleanupworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) queuecleanupworker stderr | Failed to validate security scanner V2 configuration queuecleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) queuecleanupworker stderr | self._legacy_model = NoopV2SecurityScanner() repositoryactioncounter stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) repositoryactioncounter stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) repositoryactioncounter stderr | Failed to validate security scanner V2 configuration repositoryactioncounter stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) repositoryactioncounter stderr | self._legacy_model = NoopV2SecurityScanner() builder stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) builder stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) builder stderr | Failed to validate security scanner V2 configuration builder stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) builder stderr | self._legacy_model = NoopV2SecurityScanner() repositorygcworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) repositorygcworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) repositorygcworker stderr | Failed to validate security scanner V2 configuration repositorygcworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) repositorygcworker stderr | self._legacy_model = NoopV2SecurityScanner() securityscanningnotificationworker stdout | 2022-05-05 11:01:57,993 [106] [DEBUG] [__main__] Security scanner disabled; sleeping teamsyncworker stdout | 2022-05-05 11:01:58,019 [117] [DEBUG] [__main__] Team syncing is disabled; sleeping notificationworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) notificationworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) notificationworker stderr | Failed to validate security scanner V2 configuration notificationworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) notificationworker stderr | self._legacy_model = NoopV2SecurityScanner() blobuploadcleanupworker stdout | 2022-05-05 11:01:58,129 [61] [DEBUG] [workers.worker] Scheduling worker. blobuploadcleanupworker stdout | 2022-05-05 11:01:58,140 [61] [INFO] [apscheduler.scheduler] Scheduler started blobuploadcleanupworker stdout | 2022-05-05 11:01:58,164 [61] [DEBUG] [apscheduler.scheduler] Looking for jobs to run blobuploadcleanupworker stdout | 2022-05-05 11:01:58,164 [61] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:37:39.165247 blobuploadcleanupworker stdout | 2022-05-05 11:01:58,165 [61] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added buildlogsarchiver stdout | 2022-05-05 11:01:58,227 [63] [DEBUG] [workers.worker] Scheduling worker. manifestbackfillworker stdout | 2022-05-05 11:01:58,237 [75] [DEBUG] [workers.worker] Scheduling worker. buildlogsarchiver stdout | 2022-05-05 11:01:58,244 [63] [INFO] [apscheduler.scheduler] Scheduler started manifestbackfillworker stdout | 2022-05-05 11:01:58,252 [75] [INFO] [apscheduler.scheduler] Scheduler started namespacegcworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) namespacegcworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) namespacegcworker stderr | Failed to validate security scanner V2 configuration namespacegcworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) namespacegcworker stderr | self._legacy_model = NoopV2SecurityScanner() manifestbackfillworker stdout | 2022-05-05 11:01:58,263 [75] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:01:58,264 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:01:58,264 [63] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added buildlogsarchiver stdout | 2022-05-05 11:01:58,264 [63] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:16.265236 manifestbackfillworker stdout | 2022-05-05 11:01:58,264 [75] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:03:18.264992 manifestbackfillworker stdout | 2022-05-05 11:01:58,264 [75] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added blobuploadcleanupworker stdout | 2022-05-05 11:01:58,296 [61] [INFO] [apscheduler.scheduler] Added job "BlobUploadCleanupWorker._try_cleanup_uploads" to job store "default" blobuploadcleanupworker stdout | 2022-05-05 11:01:58,319 [61] [DEBUG] [apscheduler.scheduler] Looking for jobs to run blobuploadcleanupworker stdout | 2022-05-05 11:01:58,319 [61] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:37:39.165247+00:00 (in 2140.845905 seconds) repositorygcworker stdout | 2022-05-05 11:01:58,365 [104] [DEBUG] [__main__] Starting repository GC worker queuecleanupworker stdout | 2022-05-05 11:01:58,378 [98] [DEBUG] [workers.worker] Scheduling worker. queuecleanupworker stdout | 2022-05-05 11:01:58,379 [98] [INFO] [apscheduler.scheduler] Scheduler started queuecleanupworker stdout | 2022-05-05 11:01:58,392 [98] [DEBUG] [apscheduler.scheduler] Looking for jobs to run queuecleanupworker stdout | 2022-05-05 11:01:58,392 [98] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added queuecleanupworker stdout | 2022-05-05 11:01:58,392 [98] [DEBUG] [workers.worker] First run scheduled for 2022-05-06 05:39:04.393326 manifestbackfillworker stdout | 2022-05-05 11:01:58,394 [75] [INFO] [apscheduler.scheduler] Added job "ManifestBackfillWorker._backfill_manifests" to job store "default" manifestbackfillworker stdout | 2022-05-05 11:01:58,395 [75] [DEBUG] [apscheduler.scheduler] Looking for jobs to run manifestbackfillworker stdout | 2022-05-05 11:01:58,396 [75] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:18.264992+00:00 (in 79.869001 seconds) repositoryactioncounter stdout | 2022-05-05 11:01:58,410 [102] [DEBUG] [workers.worker] Scheduling worker. globalpromstats stdout | 2022-05-05 11:01:58,417 [69] [DEBUG] [workers.worker] Scheduling worker. repositorygcworker stdout | 2022-05-05 11:01:58,420 [104] [DEBUG] [workers.worker] Scheduling worker. repositoryactioncounter stdout | 2022-05-05 11:01:58,424 [102] [INFO] [apscheduler.scheduler] Scheduler started globalpromstats stdout | 2022-05-05 11:01:58,424 [69] [INFO] [apscheduler.scheduler] Scheduler started repositorygcworker stdout | 2022-05-05 11:01:58,427 [104] [INFO] [apscheduler.scheduler] Scheduler started buildlogsarchiver stdout | 2022-05-05 11:01:58,428 [63] [INFO] [apscheduler.scheduler] Added job "ArchiveBuildLogsWorker._archive_redis_buildlogs" to job store "default" buildlogsarchiver stdout | 2022-05-05 11:01:58,428 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:01:58,428 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:16.265236+00:00 (in 17.836809 seconds) globalpromstats stdout | 2022-05-05 11:01:58,430 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run globalpromstats stdout | 2022-05-05 11:01:58,431 [69] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added globalpromstats stdout | 2022-05-05 11:01:58,430 [69] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:22:13.431348 repositoryactioncounter stdout | 2022-05-05 11:01:58,436 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2022-05-05 11:01:58,436 [102] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added repositoryactioncounter stdout | 2022-05-05 11:01:58,436 [102] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 12:40:58.437438 repositorygcworker stdout | 2022-05-05 11:01:58,435 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:01:58,435 [104] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:51.436849 chunkcleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) chunkcleanupworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) chunkcleanupworker stderr | Failed to validate security scanner V2 configuration chunkcleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) chunkcleanupworker stderr | self._legacy_model = NoopV2SecurityScanner() repositorygcworker stdout | 2022-05-05 11:01:58,439 [104] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added servicekey stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) servicekey stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) servicekey stderr | Failed to validate security scanner V2 configuration servicekey stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) servicekey stderr | self._legacy_model = NoopV2SecurityScanner() repositorygcworker stdout | 2022-05-05 11:01:58,513 [104] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" repositorygcworker stdout | 2022-05-05 11:01:58,515 [104] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:03:47.516588 repositorygcworker stdout | 2022-05-05 11:01:58,515 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:01:58,517 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:51.436849+00:00 (in 52.919714 seconds) expiredappspecifictokenworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) expiredappspecifictokenworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) expiredappspecifictokenworker stderr | Failed to validate security scanner V2 configuration expiredappspecifictokenworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) expiredappspecifictokenworker stderr | self._legacy_model = NoopV2SecurityScanner() repositorygcworker stdout | 2022-05-05 11:01:58,520 [104] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" queuecleanupworker stdout | 2022-05-05 11:01:58,521 [98] [INFO] [apscheduler.scheduler] Added job "QueueCleanupWorker._cleanup_queue" to job store "default" queuecleanupworker stdout | 2022-05-05 11:01:58,521 [98] [DEBUG] [apscheduler.scheduler] Looking for jobs to run queuecleanupworker stdout | 2022-05-05 11:01:58,521 [98] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-06 05:39:04.393326+00:00 (in 67025.872074 seconds) repositorygcworker stdout | 2022-05-05 11:01:58,522 [104] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:49.523944 repositorygcworker stdout | 2022-05-05 11:01:58,523 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:01:58,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:51.436849+00:00 (in 52.912758 seconds) repositorygcworker stdout | 2022-05-05 11:01:58,525 [104] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" repositorygcworker stdout | 2022-05-05 11:01:58,530 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:01:58,530 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:49.523944+00:00 (in 50.993539 seconds) builder stdout | 2022-05-05 11:01:58,533 [62] [DEBUG] [__main__] Building is disabled. Please enable the feature flag storagereplication stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) storagereplication stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) storagereplication stderr | Failed to validate security scanner V2 configuration storagereplication stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) storagereplication stderr | self._legacy_model = NoopV2SecurityScanner() gcworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gcworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) gcworker stderr | Failed to validate security scanner V2 configuration gcworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gcworker stderr | self._legacy_model = NoopV2SecurityScanner() globalpromstats stdout | 2022-05-05 11:01:58,597 [69] [INFO] [apscheduler.scheduler] Added job "GlobalPrometheusStatsWorker._try_report_stats" to job store "default" globalpromstats stdout | 2022-05-05 11:01:58,598 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run globalpromstats stdout | 2022-05-05 11:01:58,598 [69] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:13.431348+00:00 (in 1214.832687 seconds) servicekey stdout | 2022-05-05 11:01:58,622 [114] [DEBUG] [workers.worker] Scheduling worker. servicekey stdout | 2022-05-05 11:01:58,622 [114] [INFO] [apscheduler.scheduler] Scheduler started servicekey stdout | 2022-05-05 11:01:58,623 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run servicekey stdout | 2022-05-05 11:01:58,623 [114] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:30:25.624140 repositoryactioncounter stdout | 2022-05-05 11:01:58,625 [102] [INFO] [apscheduler.scheduler] Added job "RepositoryActionCountWorker._run_counting" to job store "default" repositoryactioncounter stdout | 2022-05-05 11:01:58,625 [102] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositoryactioncounter stdout | 2022-05-05 11:01:58,625 [102] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 12:40:58.437438+00:00 (in 5939.811545 seconds) namespacegcworker stdout | 2022-05-05 11:01:58,639 [80] [DEBUG] [__main__] Starting namespace GC worker servicekey stdout | 2022-05-05 11:01:58,623 [114] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added gunicorn-secscan stdout | 2022-05-05 11:01:58,646 [71] [DEBUG] [util.ipresolver] Finished building AWS IP ranges servicekey stdout | 2022-05-05 11:01:58,658 [114] [INFO] [apscheduler.scheduler] Added job "ServiceKeyWorker._refresh_service_key" to job store "default" servicekey stdout | 2022-05-05 11:01:58,658 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run servicekey stdout | 2022-05-05 11:01:58,658 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:25.624140+00:00 (in 1706.965206 seconds) notificationworker stdout | 2022-05-05 11:01:58,665 [84] [DEBUG] [workers.worker] Scheduling worker. notificationworker stdout | 2022-05-05 11:01:58,666 [84] [INFO] [apscheduler.scheduler] Scheduler started namespacegcworker stdout | 2022-05-05 11:01:58,683 [80] [DEBUG] [workers.worker] Scheduling worker. notificationworker stdout | 2022-05-05 11:01:58,684 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:01:58,684 [84] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:05.685352 notificationworker stdout | 2022-05-05 11:01:58,684 [84] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added namespacegcworker stdout | 2022-05-05 11:01:58,697 [80] [INFO] [apscheduler.scheduler] Scheduler started namespacegcworker stdout | 2022-05-05 11:01:58,704 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:01:58,704 [80] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:38.705240 namespacegcworker stdout | 2022-05-05 11:01:58,712 [80] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added gunicorn-secscan stdout | 2022-05-05 11:01:58,724 [71] [DEBUG] [data.database] Configuring database gunicorn-web stdout | 2022-05-05 11:01:58,727 [72] [DEBUG] [util.ipresolver] Finished building AWS IP ranges gunicorn-secscan stdout | 2022-05-05 11:01:58,729 [71] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-secscan stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-secscan stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) gunicorn-secscan stdout | 2022-05-05 11:01:58,733 [71] [WARNING] [data.secscan_model.secscan_v2_model] Failed to validate security scanner V2 configuration gunicorn-secscan stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-secscan stderr | self._legacy_model = NoopV2SecurityScanner() gunicorn-secscan stdout | 2022-05-05 11:01:58,736 [71] [INFO] [data.secscan_model] =============================== gunicorn-secscan stdout | 2022-05-05 11:01:58,737 [71] [INFO] [data.secscan_model] Using split secscan model: `[, ]` gunicorn-secscan stdout | 2022-05-05 11:01:58,740 [71] [INFO] [data.secscan_model] =============================== gunicorn-secscan stdout | 2022-05-05 11:01:58,741 [71] [DEBUG] [data.logs_model] Configuring log lodel gunicorn-secscan stdout | 2022-05-05 11:01:58,742 [71] [INFO] [data.logs_model] =============================== gunicorn-secscan stdout | 2022-05-05 11:01:58,743 [71] [INFO] [data.logs_model] Using logs model `` gunicorn-secscan stdout | 2022-05-05 11:01:58,744 [71] [INFO] [data.logs_model] =============================== gunicorn-secscan stdout | 2022-05-05 11:01:58,751 [71] [DEBUG] [__config__] Starting secscan gunicorn with 4 workers and gevent worker class notificationworker stdout | 2022-05-05 11:01:58,771 [84] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" chunkcleanupworker stdout | 2022-05-05 11:01:58,780 [64] [DEBUG] [__main__] Swift storage not detected; sleeping notificationworker stdout | 2022-05-05 11:01:58,782 [84] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:05:31.783119 notificationworker stdout | 2022-05-05 11:01:58,782 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:01:58,782 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:05.685352+00:00 (in 6.902920 seconds) notificationworker stdout | 2022-05-05 11:01:58,782 [84] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" notificationworker stdout | 2022-05-05 11:01:58,783 [84] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:32.784864 notificationworker stdout | 2022-05-05 11:01:58,784 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:01:58,784 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:05.685352+00:00 (in 6.900622 seconds) notificationworker stdout | 2022-05-05 11:01:58,784 [84] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" notificationworker stdout | 2022-05-05 11:01:58,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:01:58,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:05.685352+00:00 (in 6.900196 seconds) namespacegcworker stdout | 2022-05-05 11:01:58,793 [80] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" namespacegcworker stdout | 2022-05-05 11:01:58,793 [80] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:04:09.794132 namespacegcworker stdout | 2022-05-05 11:01:58,793 [80] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" namespacegcworker stdout | 2022-05-05 11:01:58,793 [80] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:32.794430 namespacegcworker stdout | 2022-05-05 11:01:58,793 [80] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" namespacegcworker stdout | 2022-05-05 11:01:58,793 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:01:58,793 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:32.794430+00:00 (in 34.000601 seconds) expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,805 [66] [DEBUG] [__main__] Starting expired app specific token GC worker expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,823 [66] [DEBUG] [__main__] Found expiration window: 1d expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,825 [66] [DEBUG] [workers.worker] Scheduling worker. expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,825 [66] [INFO] [apscheduler.scheduler] Scheduler started expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,826 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,826 [66] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:07:34.827355 storagereplication stdout | 2022-05-05 11:01:58,826 [115] [DEBUG] [__main__] Full storage replication disabled; skipping gcworker stdout | 2022-05-05 11:01:58,837 [68] [DEBUG] [workers.worker] Scheduling worker. gcworker stdout | 2022-05-05 11:01:58,838 [68] [INFO] [apscheduler.scheduler] Scheduler started expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,826 [66] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added gcworker stdout | 2022-05-05 11:01:58,856 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:01:58,856 [68] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:28.857216 gcworker stdout | 2022-05-05 11:01:58,856 [68] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,862 [66] [INFO] [apscheduler.scheduler] Added job "ExpiredAppSpecificTokenWorker._gc_expired_tokens" to job store "default" expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,862 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run expiredappspecifictokenworker stdout | 2022-05-05 11:01:58,862 [66] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:34.827355+00:00 (in 335.965069 seconds) gcworker stdout | 2022-05-05 11:01:58,899 [68] [INFO] [apscheduler.scheduler] Added job "GarbageCollectionWorker._garbage_collection_repos" to job store "default" gcworker stdout | 2022-05-05 11:01:58,901 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:01:58,901 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:28.857216+00:00 (in 29.955593 seconds) exportactionlogsworker stdout | 2022-05-05 11:01:58,908 [67] [DEBUG] [__main__] Starting export action logs worker gunicorn-web stdout | 2022-05-05 11:01:58,907 [72] [DEBUG] [data.database] Configuring database gunicorn-web stdout | 2022-05-05 11:01:58,909 [72] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2022-05-05 11:01:58,909 [72] [WARNING] [data.secscan_model.secscan_v2_model] Failed to validate security scanner V2 configuration gunicorn-web stdout | 2022-05-05 11:01:58,910 [72] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2022-05-05 11:01:58,910 [72] [INFO] [data.secscan_model] Using split secscan model: `[, ]` gunicorn-web stdout | 2022-05-05 11:01:58,910 [72] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2022-05-05 11:01:58,910 [72] [DEBUG] [data.logs_model] Configuring log lodel gunicorn-web stdout | 2022-05-05 11:01:58,910 [72] [INFO] [data.logs_model] =============================== gunicorn-web stdout | 2022-05-05 11:01:58,910 [72] [INFO] [data.logs_model] Using logs model `` gunicorn-web stdout | 2022-05-05 11:01:58,910 [72] [INFO] [data.logs_model] =============================== gunicorn-web stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-web stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) gunicorn-web stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-web stderr | self._legacy_model = NoopV2SecurityScanner() exportactionlogsworker stdout | 2022-05-05 11:01:58,927 [67] [DEBUG] [workers.worker] Scheduling worker. exportactionlogsworker stdout | 2022-05-05 11:01:58,927 [67] [INFO] [apscheduler.scheduler] Scheduler started exportactionlogsworker stdout | 2022-05-05 11:01:58,929 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:01:58,930 [67] [DEBUG] [apscheduler.scheduler] No jobs; waiting until a job is added exportactionlogsworker stdout | 2022-05-05 11:01:58,929 [67] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:26.930811 exportactionlogsworker stdout | 2022-05-05 11:01:58,969 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" exportactionlogsworker stdout | 2022-05-05 11:01:58,969 [67] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:06:24.970422 exportactionlogsworker stdout | 2022-05-05 11:01:58,969 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:01:58,969 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:26.930811+00:00 (in 27.961191 seconds) exportactionlogsworker stdout | 2022-05-05 11:01:58,970 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" exportactionlogsworker stdout | 2022-05-05 11:01:58,970 [67] [DEBUG] [workers.worker] First run scheduled for 2022-05-05 11:02:24.971405 exportactionlogsworker stdout | 2022-05-05 11:01:58,970 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:01:58,970 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:26.930811+00:00 (in 27.960240 seconds) exportactionlogsworker stdout | 2022-05-05 11:01:58,970 [67] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" exportactionlogsworker stdout | 2022-05-05 11:01:58,970 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:01:58,970 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:24.971405+00:00 (in 26.000499 seconds) gunicorn-web stdout | 2022-05-05 11:01:59,483 [72] [DEBUG] [__config__] Starting web gunicorn with 8 workers and gevent worker class gunicorn-registry stdout | 2022-05-05 11:01:59,867 [70] [INFO] [data.registry_model] =============================== gunicorn-registry stdout | 2022-05-05 11:01:59,867 [70] [INFO] [data.registry_model] Using registry model `` gunicorn-registry stdout | 2022-05-05 11:01:59,868 [70] [INFO] [data.registry_model] =============================== gunicorn-registry stdout | 2022-05-05 11:02:00,046 [70] [DEBUG] [app] Loading default config. gunicorn-registry stdout | 2022-05-05 11:02:00,046 [70] [DEBUG] [util.config.provider.basefileprovider] Applying config file: /quay-registry/conf/stack/config.yaml gunicorn-registry stdout | 2022-05-05 11:02:00,058 [70] [DEBUG] [app] Loaded config gunicorn-registry stdout | 2022-05-05 11:02:00,059 [70] [INFO] [util.ipresolver] Loading AWS IP ranges from disk gunicorn-registry stdout | 2022-05-05 11:02:00,072 [70] [DEBUG] [util.ipresolver] Building AWS IP ranges gunicorn-registry stdout | 2022-05-05 11:02:00,846 [70] [DEBUG] [util.ipresolver] Finished building AWS IP ranges gunicorn-registry stdout | 2022-05-05 11:02:00,904 [70] [DEBUG] [data.database] Configuring database gunicorn-registry stdout | 2022-05-05 11:02:00,905 [70] [INFO] [data.database] Connection pooling enabled for postgresql; stale timeout: None; max connection count: None gunicorn-registry stdout | 2022-05-05 11:02:00,906 [70] [WARNING] [data.secscan_model.secscan_v2_model] Failed to validate security scanner V2 configuration gunicorn-registry stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-registry stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) gunicorn-registry stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-registry stderr | self._legacy_model = NoopV2SecurityScanner() gunicorn-registry stdout | 2022-05-05 11:02:00,906 [70] [INFO] [data.secscan_model] =============================== gunicorn-registry stdout | 2022-05-05 11:02:00,906 [70] [INFO] [data.secscan_model] Using split secscan model: `[, ]` gunicorn-registry stdout | 2022-05-05 11:02:00,906 [70] [INFO] [data.secscan_model] =============================== gunicorn-registry stdout | 2022-05-05 11:02:00,906 [70] [DEBUG] [data.logs_model] Configuring log lodel gunicorn-registry stdout | 2022-05-05 11:02:00,906 [70] [INFO] [data.logs_model] =============================== gunicorn-registry stdout | 2022-05-05 11:02:00,906 [70] [INFO] [data.logs_model] Using logs model `` gunicorn-registry stdout | 2022-05-05 11:02:00,906 [70] [INFO] [data.logs_model] =============================== gunicorn-registry stdout | 2022-05-05 11:02:01,049 [70] [DEBUG] [__config__] Starting registry gunicorn with 16 workers and gevent worker class notificationworker stdout | 2022-05-05 11:02:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:02:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:05 UTC)" (scheduled at 2022-05-05 11:02:05.685352+00:00) notificationworker stdout | 2022-05-05 11:02:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:02:05,689 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 5, 686738), True, datetime.datetime(2022, 5, 5, 11, 2, 5, 686738), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:02:05,689 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:15.685352+00:00 (in 9.999504 seconds) notificationworker stdout | 2022-05-05 11:02:05,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:02:05,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:02:05,702 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:15 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:02:07,028 [230] [DEBUG] [app] Starting request: urn:request:836f31cd-8520-4408-84c0-b8c92282018b (/api/v1/config) gunicorn-web stdout | 2022-05-05 11:02:07,031 [230] [DEBUG] [app] Ending request: urn:request:836f31cd-8520-4408-84c0-b8c92282018b (/api/v1/config) nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:07 +0000] "GET /api/v1/config HTTP/1.1" 308 275 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.011 389 0.008) gunicorn-web stdout | 2022-05-05 11:02:07,033 [230] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:07 +0000] "GET /api/v1/config HTTP/1.0" 308 275 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:02:07,132 [230] [DEBUG] [app] Starting request: urn:request:9229deb8-1b50-4058-b608-9ea8091edb3a (/api/v1/config/) gunicorn-web stdout | 2022-05-05 11:02:07,133 [230] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:07,136 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t3"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['api', 'v1/config', 'public', 3, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:07,152 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['api', 'v1/config', 3, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:07,155 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['api', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:07,171 [230] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class gunicorn-web stdout | 2022-05-05 11:02:07,204 [230] [DEBUG] [app] Ending request: urn:request:9229deb8-1b50-4058-b608-9ea8091edb3a (/api/v1/config/) gunicorn-web stdout | 2022-05-05 11:02:07,205 [230] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:02:07,205 [230] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:07 +0000] "GET /api/v1/config/ HTTP/1.0" 404 77721 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:07 +0000] "GET /api/v1/config/ HTTP/1.1" 404 12637 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.074 390 0.072) gunicorn-web stdout | 2022-05-05 11:02:10,757 [222] [DEBUG] [app] Starting request: urn:request:155e1c74-59ef-401f-b2a1-a16fecc3676c (/api/v1/config/) gunicorn-web stdout | 2022-05-05 11:02:10,758 [222] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:10,762 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t3"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['api', 'v1/config', 'public', 3, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:10,780 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['api', 'v1/config', 3, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:10,783 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['api', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:10,796 [222] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class gunicorn-web stdout | 2022-05-05 11:02:10,830 [222] [DEBUG] [app] Ending request: urn:request:155e1c74-59ef-401f-b2a1-a16fecc3676c (/api/v1/config/) gunicorn-web stdout | 2022-05-05 11:02:10,831 [222] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:02:10,832 [222] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:10 +0000] "GET /api/v1/config/ HTTP/1.0" 404 77721 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:10 +0000] "GET /api/v1/config/ HTTP/1.1" 404 12637 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.082 549 0.084) notificationworker stdout | 2022-05-05 11:02:15,689 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:02:15,689 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:25.685352+00:00 (in 9.995747 seconds) notificationworker stdout | 2022-05-05 11:02:15,690 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:25 UTC)" (scheduled at 2022-05-05 11:02:15.685352+00:00) notificationworker stdout | 2022-05-05 11:02:15,690 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:02:15,691 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 15, 690374), True, datetime.datetime(2022, 5, 5, 11, 2, 15, 690374), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:02:15,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:02:15,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:02:15,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:02:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:02:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:02:16 UTC)" (scheduled at 2022-05-05 11:02:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:02:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 2, 16, 266404), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:02:16,268 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:46.265236+00:00 (in 29.999598 seconds) buildlogsarchiver stdout | 2022-05-05 11:02:16,280 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:02:16,280 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:02:16,280 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:02:46 UTC)" executed successfully nginx stdout | 2022/05/05 11:02:19 [error] 111#0: *9 open() "/quay-registry/static/css/config-setup-app-component.css" failed (2: No such file or directory), client: 93.136.90.201, server: , request: "GET /static/css/config-setup-app-component.css HTTP/1.1", host: "20.67.27.216", referrer: "http://20.67.27.216/" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:19 +0000] "GET /static/css/config-setup-app-component.css HTTP/1.1" 404 0 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 534 -) nginx stdout | 2022/05/05 11:02:19 [error] 111#0: *10 open() "/quay-registry/static/css/cor-option.css" failed (2: No such file or directory), client: 93.136.90.201, server: , request: "GET /static/css/cor-option.css HTTP/1.1", host: "20.67.27.216", referrer: "http://20.67.27.216/" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:19 +0000] "GET /static/css/cor-option.css HTTP/1.1" 404 0 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 518 -) gunicorn-web stdout | 2022-05-05 11:02:19,743 [230] [DEBUG] [app] Starting request: urn:request:47636023-1f8a-430c-a74b-885f4a8767fa (/404) gunicorn-web stdout | 2022-05-05 11:02:19,747 [230] [DEBUG] [app] Ending request: urn:request:47636023-1f8a-430c-a74b-885f4a8767fa (/404) gunicorn-web stdout | 2022-05-05 11:02:19,749 [227] [DEBUG] [app] Starting request: urn:request:7f684f6c-86db-43bb-9e53-8196db61f337 (/404) gunicorn-web stdout | 2022-05-05 11:02:19,762 [227] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class gunicorn-web stdout | 2022-05-05 11:02:19,799 [227] [DEBUG] [app] Ending request: urn:request:7f684f6c-86db-43bb-9e53-8196db61f337 (/404) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:20 +0000] "GET /static/img/network-tile.png HTTP/1.1" 200 6289 "http://20.67.27.216/static/css/quay.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 546 -) gunicorn-web stdout | 2022-05-05 11:02:20,524 [222] [DEBUG] [app] Starting request: urn:request:4d739ab0-3e4d-43d6-a053-76ac20d31eae (/api/v1/config/) gunicorn-web stdout | 2022-05-05 11:02:20,524 [222] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:20,525 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t3"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['api', 'v1/config', 'public', 3, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:20,537 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['api', 'v1/config', 3, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:20,540 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['api', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:20,546 [222] [DEBUG] [app] Ending request: urn:request:4d739ab0-3e4d-43d6-a053-76ac20d31eae (/api/v1/config/) gunicorn-web stdout | 2022-05-05 11:02:20,547 [222] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:02:20,547 [222] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:20 +0000] "GET /api/v1/config/ HTTP/1.0" 404 77721 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:20 +0000] "GET /api/v1/config/ HTTP/1.1" 404 12637 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.025 569 0.020) logrotateworker stdout | 2022-05-05 11:02:22,414 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:02:22,656 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:02:22,719 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:02:22,746 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositorygcworker stdout | 2022-05-05 11:02:22,799 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:02:22,800 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} builder stdout | 2022-05-05 11:02:22,815 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} notificationworker stdout | 2022-05-05 11:02:22,867 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:02:22,897 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:02:22,951 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:02:22,979 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:02:23,031 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:02:23,061 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:02:23,082 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:02:23,098 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:02:23,179 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:02:23,182 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:02:23,365 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:02:23,430 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:02:24,271 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:02:24,274 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:02:24,279 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:02:24,280 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-secscan stdout | 2022-05-05 11:02:24,284 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-web stdout | 2022-05-05 11:02:24,333 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:02:24,336 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:02:24,339 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:02:24,343 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:02:24,345 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:02:24,349 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:02:24,353 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:02:24,356 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:02:24,359 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:02:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:02:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:02:24 UTC)" (scheduled at 2022-05-05 11:02:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:02:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:26.930811+00:00 (in 1.958915 seconds) exportactionlogsworker stdout | 2022-05-05 11:02:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:02:24,973 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:02:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:02:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:32.784864+00:00 (in 7.098786 seconds) notificationworker stdout | 2022-05-05 11:02:25,687 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:35 UTC)" (scheduled at 2022-05-05 11:02:25.685352+00:00) notificationworker stdout | 2022-05-05 11:02:25,687 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:02:25,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 25, 687273), True, datetime.datetime(2022, 5, 5, 11, 2, 25, 687273), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:02:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:02:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:02:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:02:26,932 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:02:26,932 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:24.971405+00:00 (in 58.039101 seconds) exportactionlogsworker stdout | 2022-05-05 11:02:26,932 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:26 UTC)" (scheduled at 2022-05-05 11:02:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:02:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:02:26,934 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 26, 932955), True, datetime.datetime(2022, 5, 5, 11, 2, 26, 932955), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:02:26,947 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:02:26,947 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:02:26,947 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:02:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:02:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:02:28 UTC)" (scheduled at 2022-05-05 11:02:28.857216+00:00) gcworker stdout | 2022-05-05 11:02:28,858 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100]) gcworker stdout | 2022-05-05 11:02:28,859 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:58.857216+00:00 (in 29.999522 seconds) gcworker stdout | 2022-05-05 11:02:28,869 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:02:28,869 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:02:28,869 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:02:58 UTC)" executed successfully nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:29 +0000] "GET /static/img/network-tile.png HTTP/1.1" 200 6289 "http://20.67.27.216/static/css/quay.css" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 546 -) gunicorn-registry stdout | 2022-05-05 11:02:30,084 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:02:30,114 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:02:30,119 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:02:30,127 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:02:30,133 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:02:30,138 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:02:30,147 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:02:30,152 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:02:30,156 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:02:30,160 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:02:30,164 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:02:30,169 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:02:30,176 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:02:30,180 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:02:30,185 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:02:30,190 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:02:30,200 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-web stdout | 2022-05-05 11:02:30,316 [222] [DEBUG] [app] Starting request: urn:request:e3427cec-a39f-43e8-8267-74be6b91499d (/api/v1/config/) gunicorn-web stdout | 2022-05-05 11:02:30,317 [222] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:30,318 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t3"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['api', 'v1/config', 'public', 3, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:30,330 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['api', 'v1/config', 3, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:30,332 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['api', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:30,338 [222] [DEBUG] [app] Ending request: urn:request:e3427cec-a39f-43e8-8267-74be6b91499d (/api/v1/config/) gunicorn-web stdout | 2022-05-05 11:02:30,339 [222] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:02:30,340 [222] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:30 +0000] "GET /api/v1/config/ HTTP/1.0" 404 77721 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:30 +0000] "GET /api/v1/config/ HTTP/1.1" 404 12637 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.024 569 0.024) notificationworker stdout | 2022-05-05 11:02:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:02:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:35.685352+00:00 (in 2.899818 seconds) notificationworker stdout | 2022-05-05 11:02:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:32 UTC)" (scheduled at 2022-05-05 11:02:32.784864+00:00) notificationworker stdout | 2022-05-05 11:02:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:02:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:02:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:02:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:02:32 UTC)" (scheduled at 2022-05-05 11:02:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:02:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:02:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:02:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:02:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:38.705240+00:00 (in 5.910363 seconds) notificationworker stdout | 2022-05-05 11:02:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:02:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:45.685352+00:00 (in 9.999276 seconds) notificationworker stdout | 2022-05-05 11:02:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:45 UTC)" (scheduled at 2022-05-05 11:02:35.685352+00:00) notificationworker stdout | 2022-05-05 11:02:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:02:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 35, 686727), True, datetime.datetime(2022, 5, 5, 11, 2, 35, 686727), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:02:35,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:02:35,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:02:35,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:02:38,706 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:02:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:32.794430+00:00 (in 54.087660 seconds) namespacegcworker stdout | 2022-05-05 11:02:38,707 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:38 UTC)" (scheduled at 2022-05-05 11:02:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:02:38,707 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:02:38,709 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 38, 707527), True, datetime.datetime(2022, 5, 5, 11, 2, 38, 707527), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:02:38,721 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:02:38,721 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:02:38,721 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:38 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:02:39,507 [230] [DEBUG] [app] Starting request: urn:request:f453c030-b228-4f47-bf10-b94cd0364845 (/signin) gunicorn-web stdout | 2022-05-05 11:02:39,509 [230] [DEBUG] [app] Ending request: urn:request:f453c030-b228-4f47-bf10-b94cd0364845 (/signin) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /signin HTTP/1.1" 308 261 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.003 565 0.000) gunicorn-web stdout | 2022-05-05 11:02:39,510 [230] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:02:39 +0000] "GET /signin HTTP/1.0" 308 261 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:02:39,556 [229] [DEBUG] [app] Starting request: urn:request:810b0a03-5e39-4226-b8e5-b12f445050b1 (/signin/) gunicorn-web stdout | 2022-05-05 11:02:39,569 [229] [DEBUG] [endpoints.api.discovery] Unable to find method for POST in class gunicorn-web stdout | 2022-05-05 11:02:39,601 [229] [DEBUG] [app] Ending request: urn:request:810b0a03-5e39-4226-b8e5-b12f445050b1 (/signin/) gunicorn-web stdout | 2022-05-05 11:02:39,602 [229] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:02:39 +0000] "GET /signin/ HTTP/1.0" 200 77513 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /signin/ HTTP/1.1" 200 12545 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.052 566 0.052) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.css-4b15a4ede750.css HTTP/1.1" 200 1482 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 560 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/cal-heatmap.css-904c3b9e8a60.css HTTP/1.1" 200 799 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 543 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/ng-tags-input.min.css-7782190f81cd.css HTTP/1.1" 200 1079 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 549 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/angular-sanitize.min.js-ff589de0ec1b.js HTTP/1.1" 200 3128 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 535 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/angular-animate.min.js-636f7a51b2e1.js HTTP/1.1" 200 10309 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 534 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/angular.min.js-f0f4228b82f7.js HTTP/1.1" 200 63500 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 526 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/angular-route.min.js-590b72b0eb88.js HTTP/1.1" 200 2248 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 532 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/angular-cookies.min.js-2455ea25d522.js HTTP/1.1" 200 826 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 534 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/momentjs-66a52705d33f.js HTTP/1.1" 200 19477 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 520 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/bootstrap-datepicker.min.js-3e3d8e141d5e.js HTTP/1.1" 200 9323 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 539 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/bootstrap-datetimepicker.min.js-6612bb423b71.js HTTP/1.1" 200 10832 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 543 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/raven.min.js-ecd480647a39.js HTTP/1.1" 200 9505 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 524 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/bootbox4.1.0underscorejs1.5.2restangular1.2.0d3js3.3.3-6d47ddfef9c5.js HTTP/1.1" 200 71199 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 566 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/angular-recaptcha.min.js-23859fca3602.js HTTP/1.1" 200 1793 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 536 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/cal-heatmap.min.js-8ffad728269a.js HTTP/1.1" 200 13004 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 530 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/ng-tags-input.min.js-fa3026ba8409.js HTTP/1.1" 200 6102 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 532 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/typeahead.bundle.min.js-716151ca4e5d.js HTTP/1.1" 200 16673 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 535 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/standalonelib/jquery.overscroll.min.js HTTP/1.1" 200 3491 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 530 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/bootstrap.min.js-0e773844b374.js HTTP/1.1" 200 11303 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 528 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/ldn/jquery.js-3c5c5966471e.js HTTP/1.1" 200 102811 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.041 521 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/build/main-quay-frontend-5ea249496a1709584ff2.bundle.js HTTP/1.1" 200 707101 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.064 547 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:39 +0000] "GET /static/img/RedHat.svg HTTP/1.1" 200 1245 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 528 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:40 +0000] "GET /static/build/83-quay-frontend.chunk.js HTTP/1.1" 200 1717 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 523 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:40 +0000] "GET /static/build/18-quay-frontend.chunk.js HTTP/1.1" 200 997 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 523 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:40 +0000] "GET /static/build/135-quay-frontend.chunk.js HTTP/1.1" 200 974 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 524 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:40 +0000] "GET /static/build/112-quay-frontend.chunk.js HTTP/1.1" 200 767 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 524 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:40 +0000] "GET /static/build/181-quay-frontend.chunk.js HTTP/1.1" 200 951 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 524 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:40 +0000] "GET /static/build/152-quay-frontend.chunk.js HTTP/1.1" 200 313 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 524 -) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:40 +0000] "GET /static/img/quay_favicon.png HTTP/1.1" 200 3558 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 534 -) gunicorn-web stdout | 2022-05-05 11:02:40,331 [227] [DEBUG] [app] Starting request: urn:request:739650b5-8f50-49af-84f7-ad3c88ae91a4 (/api/v1/user/) gunicorn-web stdout | 2022-05-05 11:02:40,331 [227] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:40,334 [227] [DEBUG] [app] Ending request: urn:request:739650b5-8f50-49af-84f7-ad3c88ae91a4 (/api/v1/user/) nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:40 +0000] "GET /api/v1/user/ HTTP/1.1" 401 239 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.005 688 0.004) gunicorn-web stdout | 2022-05-05 11:02:40,335 [227] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:40 +0000] "GET /api/v1/user/ HTTP/1.0" 401 239 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:02:40,366 [222] [DEBUG] [app] Starting request: urn:request:3eb811f6-0278-4880-b66b-ee2e8a630917 (/api/v1/messages) gunicorn-web stdout | 2022-05-05 11:02:40,366 [222] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:40,368 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."content", "t1"."uuid", "t1"."severity", "t1"."media_type_id", "t2"."id", "t2"."name" FROM "messages" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id")', []) gunicorn-web stdout | 2022-05-05 11:02:40,381 [222] [DEBUG] [app] Ending request: urn:request:3eb811f6-0278-4880-b66b-ee2e8a630917 (/api/v1/messages) gunicorn-web stdout | 2022-05-05 11:02:40,382 [222] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:40 +0000] "GET /api/v1/messages HTTP/1.1" 200 17 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.018 691 0.016) gunicorn-web stdout | 2022-05-05 11:02:40,382 [222] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:40 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:02:40 +0000] "GET /static/img/RH_Logo_Quay_Black_UX-horizontal.svg HTTP/1.1" 200 3222 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.000 554 -) notificationworker stdout | 2022-05-05 11:02:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:02:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:55.685352+00:00 (in 9.999289 seconds) notificationworker stdout | 2022-05-05 11:02:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:55 UTC)" (scheduled at 2022-05-05 11:02:45.685352+00:00) notificationworker stdout | 2022-05-05 11:02:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:02:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 45, 686618), True, datetime.datetime(2022, 5, 5, 11, 2, 45, 686618), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:02:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:02:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:02:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:02:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:02:46,268 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:02:46,269 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:16.265236+00:00 (in 29.996363 seconds) buildlogsarchiver stdout | 2022-05-05 11:02:46,269 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:03:16 UTC)" (scheduled at 2022-05-05 11:02:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:02:46,270 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 2, 46, 269391), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:02:46,283 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:02:46,283 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:02:46,283 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:03:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:02:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:02:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:02:49 UTC)" (scheduled at 2022-05-05 11:02:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:02:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:02:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:02:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:02:49,525 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:02:51.436849+00:00 (in 1.912439 seconds) repositorygcworker stdout | 2022-05-05 11:02:51,438 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:02:51,439 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:47.516588+00:00 (in 56.077713 seconds) repositorygcworker stdout | 2022-05-05 11:02:51,439 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:51 UTC)" (scheduled at 2022-05-05 11:02:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:02:51,439 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:02:51,441 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 51, 439511), True, datetime.datetime(2022, 5, 5, 11, 2, 51, 439511), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:02:51,455 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:02:51,455 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:02:51,455 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:03:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:02:52,454 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:02:52,697 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:02:52,737 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:02:52,788 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositoryactioncounter stdout | 2022-05-05 11:02:52,834 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:02:52,839 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:02:52,843 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} notificationworker stdout | 2022-05-05 11:02:52,886 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:02:52,935 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:02:52,972 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:02:53,015 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:02:53,047 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:02:53,080 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:02:53,122 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:02:53,136 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:02:53,203 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:02:53,215 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:02:53,389 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:02:53,448 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:02:54,286 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:02:54,292 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:02:54,296 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:02:54,303 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-secscan stdout | 2022-05-05 11:02:54,308 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-web stdout | 2022-05-05 11:02:54,347 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:02:54,352 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:02:54,356 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:02:54,362 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:02:54,368 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:02:54,374 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:02:54,379 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:02:54,384 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:02:54,388 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} gunicorn-web stdout | 2022-05-05 11:02:55,382 [227] [DEBUG] [app] Starting request: urn:request:67cc9ae1-1b1b-4eb0-8df5-49c5a7ee3e21 (/api/v1/user/) gunicorn-web stdout | 2022-05-05 11:02:55,382 [227] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:55,387 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ((("t1"."username" = %s) AND ("t1"."organization" = %s)) AND ("t1"."robot" = %s)) LIMIT %s OFFSET %s', ['ibazulic', False, False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,400 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['ibazulic', 'ibazulic@redhat.com', 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,401 [227] [DEBUG] [data.model.user] Email and username are unique! gunicorn-web stdout | 2022-05-05 11:02:55,403 [227] [DEBUG] [peewee] ('INSERT INTO "user" ("uuid", "username", "email", "verified", "organization", "robot", "invoice_email", "invalid_login_attempts", "last_invalid_login", "removed_tag_expiration_s", "enabled", "maximum_queued_builds_count", "creation_date") VALUES (%s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s, %s) RETURNING "user"."id"', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', 'ibazulic', 'ibazulic@redhat.com', False, False, False, False, 0, datetime.datetime(2022, 5, 5, 11, 2, 55, 402548), 1209600, True, None, datetime.datetime(2022, 5, 5, 11, 2, 55, 402550)]) notificationworker stdout | 2022-05-05 11:02:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:02:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:05.685352+00:00 (in 9.999339 seconds) notificationworker stdout | 2022-05-05 11:02:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:05 UTC)" (scheduled at 2022-05-05 11:02:55.685352+00:00) notificationworker stdout | 2022-05-05 11:02:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:02:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 2, 55, 686691), True, datetime.datetime(2022, 5, 5, 11, 2, 55, 686691), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:02:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:02:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:02:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:05 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:02:55,734 [227] [DEBUG] [peewee] ('UPDATE "user" SET "uuid" = %s, "username" = %s, "password_hash" = %s, "email" = %s, "verified" = %s, "organization" = %s, "robot" = %s, "invoice_email" = %s, "invalid_login_attempts" = %s, "last_invalid_login" = %s, "removed_tag_expiration_s" = %s, "enabled" = %s, "maximum_queued_builds_count" = %s, "creation_date" = %s WHERE ("user"."id" = %s)', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', 'ibazulic', '$2b$12$UlQo5CI4DcdmfKNNJcm.pO1PLsVlBPw6eusdEPuAvLu2rcfkKLnCm', 'ibazulic@redhat.com', True, False, False, False, 0, datetime.datetime(2022, 5, 5, 11, 2, 55, 402548), 1209600, True, None, datetime.datetime(2022, 5, 5, 11, 2, 55, 402550), 1]) gunicorn-web stdout | 2022-05-05 11:02:55,742 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,744 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,745 [227] [DEBUG] [endpoints.common] Successfully signed in as user ibazulic with uuid b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,745 [227] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:02:55,746 [227] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,747 [227] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'ibazulic']) gunicorn-web stdout | 2022-05-05 11:02:55,750 [227] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,751 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,752 [227] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:55,752 [227] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:55,752 [227] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:55,752 [227] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:02:55,753 [227] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1]) gunicorn-web stdout | 2022-05-05 11:02:55,754 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1]) gunicorn-web stdout | 2022-05-05 11:02:55,756 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['ibazulic', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,757 [227] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,758 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,759 [227] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,760 [227] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,762 [227] [DEBUG] [app] Ending request: urn:request:67cc9ae1-1b1b-4eb0-8df5-49c5a7ee3e21 (/api/v1/user/) gunicorn-web stdout | 2022-05-05 11:02:55,763 [227] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:02:55,763 [227] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:55 +0000] "POST /api/v1/user/ HTTP/1.0" 200 593 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:55 +0000] "POST /api/v1/user/ HTTP/1.1" 200 593 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.417 888 0.380) gunicorn-web stdout | 2022-05-05 11:02:55,861 [230] [DEBUG] [app] Starting request: urn:request:b25440a7-427e-489b-832a-875604ad8240 (/api/v1/user/) gunicorn-web stdout | 2022-05-05 11:02:55,861 [230] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:55,861 [230] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,861 [230] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,862 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,872 [230] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:02:55,874 [230] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:02:55,874 [230] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,874 [230] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,874 [230] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:55,874 [230] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:55,874 [230] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:55,874 [230] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:02:55,876 [230] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" INNER JOIN "team" AS "t2" ON ("t2"."organization_id" = "t1"."id") INNER JOIN "teammember" AS "t3" ON ("t3"."team_id" = "t2"."id") INNER JOIN "user" AS "t4" ON ("t4"."id" = "t3"."user_id") WHERE (("t1"."organization" = %s) AND ("t4"."username" = %s))', [True, 'ibazulic']) gunicorn-web stdout | 2022-05-05 11:02:55,879 [230] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,880 [230] [DEBUG] [peewee] ('SELECT "t1"."service_ident", "t2"."name", "t1"."metadata_json" FROM "federatedlogin" AS "t1" INNER JOIN "loginservice" AS "t2" ON ("t1"."service_id" = "t2"."id") WHERE (("t2"."name" != %s) AND ("t1"."user_id" = %s))', ['quayrobot', 1]) gunicorn-web stdout | 2022-05-05 11:02:55,882 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."kind_id" FROM "userprompt" AS "t1" INNER JOIN "userpromptkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE ("t1"."user_id" = %s)', [1]) gunicorn-web stdout | 2022-05-05 11:02:55,883 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['ibazulic', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,884 [230] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,884 [230] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,884 [230] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,886 [230] [DEBUG] [app] Ending request: urn:request:b25440a7-427e-489b-832a-875604ad8240 (/api/v1/user/) gunicorn-web stdout | 2022-05-05 11:02:55,887 [230] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:55 +0000] "GET /api/v1/user/ HTTP/1.1" 200 590 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.028 933 0.028) gunicorn-web stdout | 2022-05-05 11:02:55,887 [230] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:55 +0000] "GET /api/v1/user/ HTTP/1.0" 200 590 "http://20.67.27.216/signin/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:02:55,985 [222] [DEBUG] [app] Starting request: urn:request:2ed31e9a-11cd-46df-b1c0-57892563a2f9 (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:02:55,986 [222] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:55,986 [222] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,986 [222] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,988 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,992 [225] [DEBUG] [app] Starting request: urn:request:4f5085cd-f924-4e5e-95ed-ba54892ab05e (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:02:55,993 [225] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:55,994 [225] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,994 [225] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:55,996 [225] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:55,998 [222] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:02:55,999 [222] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:02:55,999 [222] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,000 [222] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:02:56,000 [222] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,000 [222] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:56,000 [222] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:56,000 [222] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:56,000 [222] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:02:56,003 [222] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6]) gunicorn-web stdout | 2022-05-05 11:02:56,007 [225] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:02:56,009 [222] [DEBUG] [app] Ending request: urn:request:2ed31e9a-11cd-46df-b1c0-57892563a2f9 (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:02:56,009 [225] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:02:56,009 [225] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,009 [225] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:02:56,009 [225] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,009 [225] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:56,010 [225] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:56,010 [222] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:02:56,010 [225] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:02:56,010 [225] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:56 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.027 959 0.028) gunicorn-web stdout | 2022-05-05 11:02:56,010 [222] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:56 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:02:56,011 [225] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2022, 5, 8, 6, 14, 56, 10753), datetime.datetime(2022, 5, 5, 11, 2, 56, 10896)]) gunicorn-web stdout | 2022-05-05 11:02:56,015 [225] [DEBUG] [app] Ending request: urn:request:4f5085cd-f924-4e5e-95ed-ba54892ab05e (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:02:56,016 [225] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.032 968 0.032) gunicorn-web stdout | 2022-05-05 11:02:56,017 [225] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "http://20.67.27.216/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:02:56,135 [222] [DEBUG] [app] Starting request: urn:request:f9a43ea9-b20e-490a-a8b3-209414e2fb4e (/api/v1/repository) gunicorn-web stdout | 2022-05-05 11:02:56,136 [230] [DEBUG] [app] Starting request: urn:request:bcb016a7-897a-461f-9bfc-7bf1e262d4d8 (/api/v1/repository) gunicorn-web stdout | 2022-05-05 11:02:56,136 [222] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:56,136 [230] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:02:56,136 [222] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,136 [230] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,136 [222] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,136 [230] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,137 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:56,137 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:56,148 [222] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:02:56,148 [222] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:02:56,148 [222] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,149 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-web stdout | 2022-05-05 11:02:56,150 [230] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:02:56,150 [230] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:02:56,150 [230] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:02:56,151 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['ibazulic', 1, 0]) gunicorn-web stdout | 2022-05-05 11:02:56,152 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3]) gunicorn-web stdout | 2022-05-05 11:02:56,153 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-web stdout | 2022-05-05 11:02:56,155 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "teamrole" AS "t1"', []) gunicorn-web stdout | 2022-05-05 11:02:56,157 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3]) gunicorn-web stdout | 2022-05-05 11:02:56,158 [230] [DEBUG] [peewee] ('((SELECT DISTINCT "t1"."name", "t1"."id" AS "rid", "t1"."description", "t2"."username", "t1"."visibility_id", "t1"."kind_id", "t1"."state" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") LEFT OUTER JOIN "repositorypermission" AS "t3" ON ("t3"."repository_id" = "t1"."id") WHERE (((("t1"."state" != %s) AND ("t1"."kind_id" = %s)) AND ("t2"."username" = %s)) AND ("t3"."user_id" = %s))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") INNER JOIN "team" AS "t7" ON ("t6"."team_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t8"."team_id" = "t7"."id") WHERE (((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s)) AND ("t8"."user_id" = %s)))) UNION (SELECT DISTINCT "t4"."name", "t4"."id" AS "rid", "t4"."description", "t5"."username", "t4"."visibility_id", "t4"."kind_id", "t4"."state" FROM "repository" AS "t4" INNER JOIN "user" AS "t5" ON ("t4"."namespace_user_id" = "t5"."id") LEFT OUTER JOIN "repositorypermission" AS "t6" ON ("t6"."repository_id" = "t4"."id") INNER JOIN "team" AS "t9" ON ("t9"."organization_id" = "t4"."namespace_user_id") INNER JOIN "teammember" AS "t10" ON ("t9"."id" = "t10"."team_id") WHERE ((((("t4"."state" != %s) AND ("t4"."kind_id" = %s)) AND ("t5"."username" = %s)) AND ("t9"."role_id" = %s)) AND ("t10"."user_id" = %s))) ORDER BY rid LIMIT %s', [3, 1, 'ibazulic', 1, 3, 1, 'ibazulic', 1, 3, 1, 'ibazulic', 1, 1, 101]) gunicorn-web stdout | 2022-05-05 11:02:56,159 [222] [DEBUG] [app] Ending request: urn:request:f9a43ea9-b20e-490a-a8b3-209414e2fb4e (/api/v1/repository) gunicorn-web stdout | 2022-05-05 11:02:56,160 [222] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:02:56,160 [222] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:56 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:56 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.1" 200 21 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.026 1010 0.024) gunicorn-web stdout | 2022-05-05 11:02:56,165 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed", "t3"."id", "t3"."name", "t1"."id" AS "rid" FROM "repository" AS "t1" INNER JOIN "star" AS "t4" ON ("t4"."repository_id" = "t1"."id") INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "visibility" AS "t3" ON ("t1"."visibility_id" = "t3"."id") WHERE ((("t4"."user_id" = %s) AND ("t1"."kind_id" = %s)) AND ("t1"."state" != %s))', [1, 1, 3]) gunicorn-web stdout | 2022-05-05 11:02:56,167 [230] [DEBUG] [app] Ending request: urn:request:bcb016a7-897a-461f-9bfc-7bf1e262d4d8 (/api/v1/repository) gunicorn-web stdout | 2022-05-05 11:02:56,168 [230] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:02:56 +0000] "GET /api/v1/repository?last_modified=true&namespace=ibazulic&popularity=true&state=true HTTP/1.1" 200 21 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.035 1027 0.032) gunicorn-web stdout | 2022-05-05 11:02:56,169 [230] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:02:56 +0000] "GET /api/v1/repository?last_modified=true&namespace=ibazulic&popularity=true&state=true HTTP/1.0" 200 21 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gcworker stdout | 2022-05-05 11:02:58,859 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:02:58,859 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:28.857216+00:00 (in 29.998040 seconds) gcworker stdout | 2022-05-05 11:02:58,859 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:03:28 UTC)" (scheduled at 2022-05-05 11:02:58.857216+00:00) gcworker stdout | 2022-05-05 11:02:58,859 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:02:58,859 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:03:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:03:00,099 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:03:00,127 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:03:00,132 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:03:00,138 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:03:00,145 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:03:00,152 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:03:00,156 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:03:00,166 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:03:00,170 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:03:00,176 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:03:00,180 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:03:00,190 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:03:00,193 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:03:00,199 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:03:00,204 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:03:00,208 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:03:00,213 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:03:05,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:03:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:15.685352+00:00 (in 9.999153 seconds) notificationworker stdout | 2022-05-05 11:03:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:15 UTC)" (scheduled at 2022-05-05 11:03:05.685352+00:00) notificationworker stdout | 2022-05-05 11:03:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:03:05,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 5, 686979), True, datetime.datetime(2022, 5, 5, 11, 3, 5, 686979), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:03:05,704 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:03:05,704 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:03:05,704 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:03:07,739 [245] [DEBUG] [app] Starting request: urn:request:e5bda68c-deaf-4d42-8d90-2b7bd71430b1 (/v2/) gunicorn-registry stdout | 2022-05-05 11:03:07,739 [245] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {} gunicorn-registry stdout | 2022-05-05 11:03:07,740 [245] [DEBUG] [auth.registry_jwt_auth] No auth header. gunicorn-registry stdout | 2022-05-05 11:03:07,742 [245] [DEBUG] [app] Ending request: urn:request:e5bda68c-deaf-4d42-8d90-2b7bd71430b1 (/v2/) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:07 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.007 236 0.004) gunicorn-registry stdout | 2022-05-05 11:03:07,743 [245] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:07 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:07,812 [246] [DEBUG] [app] Starting request: urn:request:e8b20cce-54ac-4842-925c-fc813e8430f3 (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:03:07,812 [246] [DEBUG] [auth.basic] Attempt to process basic auth header gunicorn-registry stdout | 2022-05-05 11:03:07,815 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['ibazulic', 'ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:07,816 [246] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:07,825 [246] [DEBUG] [peewee.pool] Created new connection 140025700771376. gunicorn-registry stdout | 2022-05-05 11:03:08,150 [246] [DEBUG] [auth.credentials] Successfully validated credentials for user ibazulic gunicorn-registry stdout | 2022-05-05 11:03:08,151 [246] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-registry stdout | 2022-05-05 11:03:08,151 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:08,151 [246] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:03:08,152 [246] [DEBUG] [endpoints.v2.v2auth] Request audience: 20.67.27.216 gunicorn-registry stdout | 2022-05-05 11:03:08,152 [246] [DEBUG] [endpoints.v2.v2auth] Scope request: [] gunicorn-registry stdout | 2022-05-05 11:03:08,163 [246] [DEBUG] [app] Ending request: urn:request:e8b20cce-54ac-4842-925c-fc813e8430f3 (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:03:08,164 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:08,164 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. nginx stdout | 93.136.90.201 () - ibazulic [05/May/2022:11:03:08 +0000] "GET /v2/auth?account=ibazulic&client_id=docker&offline_token=true&service=20.67.27.216 HTTP/1.1" 200 874 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.357 361 0.360) gunicorn-registry stdout | 2022-05-05 11:03:08,164 [246] [INFO] [gunicorn.access] 93.136.90.201 - ibazulic [05/May/2022:11:03:08 +0000] "GET /v2/auth?account=ibazulic&client_id=docker&offline_token=true&service=20.67.27.216 HTTP/1.1" 200 874 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:08,165 [246] [DEBUG] [data.userevent] Published user event docker-cli: {'action': 'login'} gunicorn-registry stdout | 2022-05-05 11:03:08,231 [245] [DEBUG] [app] Starting request: urn:request:9ad7b5e0-4e5e-4202-9a8f-f62313e4c358 (/v2/) gunicorn-registry stdout | 2022-05-05 11:03:08,231 [245] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {} gunicorn-registry stdout | 2022-05-05 11:03:08,231 [245] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NTg4LCJpYXQiOjE2NTE3NDg1ODgsImV4cCI6MTY1MTc1MjE4OCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOltdLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnt9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.hl9k14eJQgHqj_QAq06HDlSR14b3uTDlYXtAOZCtiA6msmNPCtBwNpjaKYxvxTsCdMhnl8divO3hAlWf2kaH7esj7Oy0_4tDsnkFoqM3ShJeGUJ3YXpWO94Rdbqp8QapsRi2AKB3ryPfmbvSAH1B_OiyQfwcCAeBhMO4NQMdNF5Hv8erA_5hi0LpUSiow9Vl1qxpd3hdvpTe0nb3CQREMgZO7FWPaWTExXJIQZc3kZtfNeioj5H6QuZeTM2SxEdy8tO9-dtgc3PgO3-CzzBRrXsXrkDW3VjDoQKzZBTfTgpFNt9yUEzeXAEd4v2v62rrOk6trHqLwPrjJQlbqMmiDQ gunicorn-registry stdout | 2022-05-05 11:03:08,232 [245] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NTg4LCJpYXQiOjE2NTE3NDg1ODgsImV4cCI6MTY1MTc1MjE4OCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOltdLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnt9LCJjb20uYXBvc3RpbGxlLnJvb3QiOiIkZGlzYWJsZWQifX0.hl9k14eJQgHqj_QAq06HDlSR14b3uTDlYXtAOZCtiA6msmNPCtBwNpjaKYxvxTsCdMhnl8divO3hAlWf2kaH7esj7Oy0_4tDsnkFoqM3ShJeGUJ3YXpWO94Rdbqp8QapsRi2AKB3ryPfmbvSAH1B_OiyQfwcCAeBhMO4NQMdNF5Hv8erA_5hi0LpUSiow9Vl1qxpd3hdvpTe0nb3CQREMgZO7FWPaWTExXJIQZc3kZtfNeioj5H6QuZeTM2SxEdy8tO9-dtgc3PgO3-CzzBRrXsXrkDW3VjDoQKzZBTfTgpFNt9yUEzeXAEd4v2v62rrOk6trHqLwPrjJQlbqMmiDQ gunicorn-registry stdout | 2022-05-05 11:03:08,237 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 8, 233719), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 8, 233770), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 8, 233804), datetime.datetime(2022, 4, 28, 11, 3, 8, 233841), None]) gunicorn-registry stdout | 2022-05-05 11:03:08,238 [245] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:08,246 [245] [DEBUG] [peewee.pool] Created new connection 140025700772288. gunicorn-registry stdout | 2022-05-05 11:03:08,255 [245] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:08,255 [245] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:08,255 [245] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:08,255 [245] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:08,256 [245] [DEBUG] [app] Ending request: urn:request:9ad7b5e0-4e5e-4202-9a8f-f62313e4c358 (/v2/) gunicorn-registry stdout | 2022-05-05 11:03:08,256 [245] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:08,256 [245] [DEBUG] [peewee.pool] Returning 140025700772288 to pool. gunicorn-registry stdout | 2022-05-05 11:03:08,256 [245] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:08 +0000] "GET /v2/ HTTP/1.1" 200 4 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:08 +0000] "GET /v2/ HTTP/1.1" 200 4 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.026 1121 0.028) notificationworker stdout | 2022-05-05 11:03:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:03:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:25.685352+00:00 (in 9.999315 seconds) notificationworker stdout | 2022-05-05 11:03:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:25 UTC)" (scheduled at 2022-05-05 11:03:15.685352+00:00) notificationworker stdout | 2022-05-05 11:03:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:03:15,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 15, 686799), True, datetime.datetime(2022, 5, 5, 11, 3, 15, 686799), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:03:15,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:03:15,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:03:15,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:03:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:03:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:46.265236+00:00 (in 29.999375 seconds) buildlogsarchiver stdout | 2022-05-05 11:03:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:03:46 UTC)" (scheduled at 2022-05-05 11:03:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:03:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 3, 16, 266460), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:03:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:03:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:03:16,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:03:46 UTC)" executed successfully manifestbackfillworker stdout | 2022-05-05 11:03:18,265 [75] [DEBUG] [apscheduler.scheduler] Looking for jobs to run manifestbackfillworker stdout | 2022-05-05 11:03:18,265 [75] [INFO] [apscheduler.executors.default] Running job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2022-05-05 11:03:18 UTC)" (scheduled at 2022-05-05 11:03:18.264992+00:00) manifestbackfillworker stdout | 2022-05-05 11:03:18,266 [75] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size" FROM "manifest" AS "t1" WHERE ("t1"."layers_compressed_size" IS %s) LIMIT %s OFFSET %s', [None, 1, 0]) manifestbackfillworker stdout | 2022-05-05 11:03:18,267 [75] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 12:03:18.264992+00:00 (in 3599.999555 seconds) manifestbackfillworker stdout | 2022-05-05 11:03:18,276 [75] [DEBUG] [__main__] Manifest backfill worker has completed; skipping manifestbackfillworker stdout | 2022-05-05 11:03:18,276 [75] [DEBUG] [data.database] Disconnecting from database. manifestbackfillworker stdout | 2022-05-05 11:03:18,276 [75] [INFO] [apscheduler.executors.default] Job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2022-05-05 12:03:18 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:03:22,475 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:03:22,739 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:03:22,764 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:03:22,797 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositoryactioncounter stdout | 2022-05-05 11:03:22,864 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:03:22,876 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:03:22,881 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} notificationworker stdout | 2022-05-05 11:03:22,915 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:03:22,965 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:03:23,011 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:03:23,043 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:03:23,087 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:03:23,118 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:03:23,162 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:03:23,168 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:03:23,239 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:03:23,251 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:03:23,429 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:03:23,488 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:03:24,299 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:03:24,304 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:03:24,309 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:03:24,316 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-secscan stdout | 2022-05-05 11:03:24,320 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-web stdout | 2022-05-05 11:03:24,358 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:03:24,363 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:03:24,368 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:03:24,373 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:03:24,377 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:03:24,388 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:03:24,393 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:03:24,398 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:03:24,402 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:03:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:03:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:26.930811+00:00 (in 1.958811 seconds) exportactionlogsworker stdout | 2022-05-05 11:03:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:24 UTC)" (scheduled at 2022-05-05 11:03:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:03:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:03:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:03:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:03:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:32.784864+00:00 (in 7.098827 seconds) notificationworker stdout | 2022-05-05 11:03:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:35 UTC)" (scheduled at 2022-05-05 11:03:25.685352+00:00) notificationworker stdout | 2022-05-05 11:03:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:03:25,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 25, 686667), True, datetime.datetime(2022, 5, 5, 11, 3, 25, 686667), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:03:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:03:25,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:03:25,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:03:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:03:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:24.971405+00:00 (in 58.039932 seconds) exportactionlogsworker stdout | 2022-05-05 11:03:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:26 UTC)" (scheduled at 2022-05-05 11:03:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:03:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:03:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 26, 932211), True, datetime.datetime(2022, 5, 5, 11, 3, 26, 932211), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:03:26,944 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:03:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:03:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:03:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:03:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:58.857216+00:00 (in 29.999305 seconds) gcworker stdout | 2022-05-05 11:03:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:03:58 UTC)" (scheduled at 2022-05-05 11:03:28.857216+00:00) gcworker stdout | 2022-05-05 11:03:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:03:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:03:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:03:30,117 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:03:30,141 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:03:30,152 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:03:30,157 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:03:30,163 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:03:30,168 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:03:30,173 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:03:30,179 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:03:30,183 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:03:30,188 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:03:30,193 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:03:30,204 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:03:30,214 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:03:30,219 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:03:30,225 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:03:30,230 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:03:30,235 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:03:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:03:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:35.685352+00:00 (in 2.899912 seconds) notificationworker stdout | 2022-05-05 11:03:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:32 UTC)" (scheduled at 2022-05-05 11:03:32.784864+00:00) notificationworker stdout | 2022-05-05 11:03:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:03:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:03:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:03:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:38.705240+00:00 (in 5.910131 seconds) namespacegcworker stdout | 2022-05-05 11:03:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:32 UTC)" (scheduled at 2022-05-05 11:03:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:03:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:03:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:32 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:03:33,983 [231] [DEBUG] [app] Starting request: urn:request:dfe6fcb6-97fa-4137-a4bf-6b8b54685a43 (/v2/) gunicorn-registry stdout | 2022-05-05 11:03:33,983 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {} gunicorn-registry stdout | 2022-05-05 11:03:33,983 [231] [DEBUG] [auth.registry_jwt_auth] No auth header. gunicorn-registry stdout | 2022-05-05 11:03:33,987 [231] [DEBUG] [app] Ending request: urn:request:dfe6fcb6-97fa-4137-a4bf-6b8b54685a43 (/v2/) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:33 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.008 236 0.008) gunicorn-registry stdout | 2022-05-05 11:03:33,988 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:33 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:34,058 [246] [DEBUG] [app] Starting request: urn:request:6711f6d9-f128-4ca8-9758-43abfc3d95dc (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:03:34,058 [246] [DEBUG] [auth.basic] Attempt to process basic auth header gunicorn-registry stdout | 2022-05-05 11:03:34,059 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['ibazulic', 'ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,380 [246] [DEBUG] [auth.credentials] Successfully validated credentials for user ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,380 [246] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-registry stdout | 2022-05-05 11:03:34,380 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,380 [246] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:03:34,380 [246] [DEBUG] [endpoints.v2.v2auth] Request audience: 20.67.27.216 gunicorn-registry stdout | 2022-05-05 11:03:34,380 [246] [DEBUG] [endpoints.v2.v2auth] Scope request: ['repository:ibazulic/test-big-layers:push,pull'] gunicorn-registry stdout | 2022-05-05 11:03:34,381 [246] [DEBUG] [endpoints.v2.v2auth] Match: ('ibazulic/test-big-layers', 'ibazulic/test-big-layers', 'push,pull') gunicorn-registry stdout | 2022-05-05 11:03:34,382 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,386 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,389 [246] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:03:34,389 [246] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:03:34,389 [246] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:03:34,389 [246] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:03:34,389 [246] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,390 [246] [DEBUG] [endpoints.v2.v2auth] Creating repository: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,391 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") INNER JOIN "repositorykind" AS "t3" ON ("t1"."kind_id" = "t3"."id") WHERE (((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) AND ("t3"."name" = %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 'image', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,394 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,396 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,398 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,399 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,400 [246] [DEBUG] [peewee] ('INSERT INTO "repository" ("namespace_user_id", "name", "visibility_id", "description", "badge_token", "kind_id", "trust_enabled", "state") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "repository"."id"', [1, 'test-big-layers', 2, None, '579021c0-d1e5-4a15-81b5-2b1acfb24766', 1, False, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,403 [246] [DEBUG] [peewee] ('INSERT INTO "repositoryactioncount" ("repository_id", "count", "date") VALUES (%s, %s, %s) RETURNING "repositoryactioncount"."id"', [1, 0, datetime.date(2022, 5, 4)]) gunicorn-registry stdout | 2022-05-05 11:03:34,406 [246] [DEBUG] [peewee] ('INSERT INTO "repositorysearchscore" ("repository_id", "score") VALUES (%s, %s) RETURNING "repositorysearchscore"."id"', [1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,408 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "role" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['admin', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,409 [246] [DEBUG] [peewee] ('INSERT INTO "repositorypermission" ("user_id", "repository_id", "role_id") VALUES (%s, %s, %s) RETURNING "repositorypermission"."id"', [1, 1, 1]) gunicorn-registry stdout | 2022-05-05 11:03:34,414 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,416 [246] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:03:34,417 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,427 [246] [DEBUG] [app] Ending request: urn:request:6711f6d9-f128-4ca8-9758-43abfc3d95dc (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:03:34,428 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,428 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,428 [246] [INFO] [gunicorn.access] 93.136.90.201 - ibazulic [05/May/2022:11:03:34 +0000] "GET /v2/auth?account=ibazulic&scope=repository%3Aibazulic%2Ftest-big-layers%3Apush%2Cpull&service=20.67.27.216 HTTP/1.1" 200 1033 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - ibazulic [05/May/2022:11:03:34 +0000] "GET /v2/auth?account=ibazulic&scope=repository%3Aibazulic%2Ftest-big-layers%3Apush%2Cpull&service=20.67.27.216 HTTP/1.1" 200 1033 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.371 385 0.372) gunicorn-registry stdout | 2022-05-05 11:03:34,429 [246] [DEBUG] [data.userevent] Published user event docker-cli: {'action': 'push_start', 'namespace': 'ibazulic', 'repository': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,495 [246] [DEBUG] [app] Starting request: urn:request:22923fb8-1b87-470d-9ecf-3e385137418d (/v2/ibazulic/test-big-layers/blobs/sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1) gunicorn-registry stdout | 2022-05-05 11:03:34,495 [231] [DEBUG] [app] Starting request: urn:request:e130906f-f189-43ae-a370-7545d9c6faee (/v2/ibazulic/test-big-layers/blobs/sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e) gunicorn-registry stdout | 2022-05-05 11:03:34,496 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,496 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,497 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,497 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,498 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,499 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,501 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 34, 500588), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 34, 500627), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 34, 500653), datetime.datetime(2022, 4, 28, 11, 3, 34, 500668), None]) gunicorn-registry stdout | 2022-05-05 11:03:34,501 [236] [DEBUG] [app] Starting request: urn:request:3b093162-4c48-4364-97f3-d3e015ebfc7d (/v2/ibazulic/test-big-layers/blobs/sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1) gunicorn-registry stdout | 2022-05-05 11:03:34,502 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 34, 500515), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 34, 500562), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 34, 500594), datetime.datetime(2022, 4, 28, 11, 3, 34, 500609), None]) gunicorn-registry stdout | 2022-05-05 11:03:34,502 [236] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,503 [231] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:34,503 [236] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,503 [236] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,504 [242] [DEBUG] [app] Starting request: urn:request:24980165-23dc-42fb-b803-b304ba83ebbd (/v2/ibazulic/test-big-layers/blobs/sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a) gunicorn-registry stdout | 2022-05-05 11:03:34,506 [242] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,506 [242] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,507 [242] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,507 [240] [DEBUG] [app] Starting request: urn:request:3031a60c-32a8-4b96-8b79-e643dbab1cd3 (/v2/ibazulic/test-big-layers/blobs/sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c) gunicorn-registry stdout | 2022-05-05 11:03:34,508 [236] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 34, 506321), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 34, 506362), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 34, 506387), datetime.datetime(2022, 4, 28, 11, 3, 34, 506405), None]) gunicorn-registry stdout | 2022-05-05 11:03:34,508 [236] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:34,508 [240] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,509 [240] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,510 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,511 [240] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,511 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,512 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,513 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,514 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,515 [246] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2 gunicorn-registry stdout | 2022-05-05 11:03:34,516 [246] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,517 [242] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 34, 510434), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 34, 510473), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 34, 510497), datetime.datetime(2022, 4, 28, 11, 3, 34, 510515), None]) gunicorn-registry stdout | 2022-05-05 11:03:34,517 [242] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:34,517 [231] [DEBUG] [peewee.pool] Created new connection 140025710725568. gunicorn-registry stdout | 2022-05-05 11:03:34,516 [240] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 34, 513539), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 34, 513579), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 34, 513603), datetime.datetime(2022, 4, 28, 11, 3, 34, 513621), None]) gunicorn-registry stdout | 2022-05-05 11:03:34,519 [236] [DEBUG] [peewee.pool] Created new connection 140025710706752. gunicorn-registry stdout | 2022-05-05 11:03:34,521 [240] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:34,522 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,526 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,526 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,526 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,526 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,526 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,527 [231] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2 gunicorn-registry stdout | 2022-05-05 11:03:34,527 [236] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,528 [236] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,528 [236] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,528 [236] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,528 [236] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,528 [236] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2 gunicorn-registry stdout | 2022-05-05 11:03:34,529 [236] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,530 [246] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,531 [236] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,531 [231] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,530 [242] [DEBUG] [peewee.pool] Created new connection 140025710710848. gunicorn-registry stdout | 2022-05-05 11:03:34,534 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,535 [236] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,536 [246] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,536 [236] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,536 [240] [DEBUG] [peewee.pool] Created new connection 140025710719040. gunicorn-registry stdout | 2022-05-05 11:03:34,538 [236] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,540 [246] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,540 [236] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,541 [242] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,541 [242] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,541 [242] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,541 [242] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,541 [242] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,541 [236] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,541 [236] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,542 [242] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2 gunicorn-registry stdout | 2022-05-05 11:03:34,542 [236] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,543 [242] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,544 [236] [DEBUG] [app] Ending request: urn:request:3b093162-4c48-4364-97f3-d3e015ebfc7d (/v2/ibazulic/test-big-layers/blobs/sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1) gunicorn-registry stdout | 2022-05-05 11:03:34,544 [236] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,545 [236] [DEBUG] [peewee.pool] Returning 140025710706752 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,544 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,545 [236] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.051 1360 0.052) gunicorn-registry stdout | 2022-05-05 11:03:34,546 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,547 [246] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,548 [231] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,548 [240] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,548 [240] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,549 [240] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,549 [240] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,549 [242] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,549 [240] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,549 [240] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2 gunicorn-registry stdout | 2022-05-05 11:03:34,549 [231] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,550 [240] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,551 [231] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,551 [231] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,551 [231] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,552 [240] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,552 [231] [DEBUG] [app] Ending request: urn:request:e130906f-f189-43ae-a370-7545d9c6faee (/v2/ibazulic/test-big-layers/blobs/sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e) gunicorn-registry stdout | 2022-05-05 11:03:34,552 [246] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,552 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,552 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,553 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:34,553 [246] [DEBUG] [app] Ending request: urn:request:22923fb8-1b87-470d-9ecf-3e385137418d (/v2/ibazulic/test-big-layers/blobs/sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1) gunicorn-registry stdout | 2022-05-05 11:03:34,553 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,553 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,554 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.059 1360 0.060) nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.059 1360 0.060) gunicorn-registry stdout | 2022-05-05 11:03:34,555 [242] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,556 [240] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,557 [242] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,558 [240] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,558 [242] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,560 [240] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,560 [242] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,562 [240] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,562 [242] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,562 [242] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,563 [242] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,563 [240] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,564 [240] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,564 [240] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,564 [242] [DEBUG] [app] Ending request: urn:request:24980165-23dc-42fb-b803-b304ba83ebbd (/v2/ibazulic/test-big-layers/blobs/sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a) gunicorn-registry stdout | 2022-05-05 11:03:34,565 [242] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,565 [242] [DEBUG] [peewee.pool] Returning 140025710710848 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,565 [242] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.071 1360 0.072) gunicorn-registry stdout | 2022-05-05 11:03:34,566 [240] [DEBUG] [app] Ending request: urn:request:3031a60c-32a8-4b96-8b79-e643dbab1cd3 (/v2/ibazulic/test-big-layers/blobs/sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c) gunicorn-registry stdout | 2022-05-05 11:03:34,567 [240] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,567 [240] [DEBUG] [peewee.pool] Returning 140025710719040 to pool. nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.070 1360 0.068) gunicorn-registry stdout | 2022-05-05 11:03:34,567 [240] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:34,612 [246] [DEBUG] [app] Starting request: urn:request:d007670e-448d-4f98-b912-473d86622210 (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,612 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,612 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,612 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,614 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,614 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,614 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,615 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,615 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,618 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,619 [231] [DEBUG] [app] Starting request: urn:request:b45a3ee8-a1f7-4e30-9d7d-a86f77cc0cc4 (/v2/ibazulic/test-big-layers/blobs/sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4) gunicorn-registry stdout | 2022-05-05 11:03:34,619 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,619 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,619 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,621 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,621 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,621 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,621 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,621 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,621 [231] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4_2 gunicorn-registry stdout | 2022-05-05 11:03:34,621 [231] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,622 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,623 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,625 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "imagestoragelocation" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,625 [231] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,625 [233] [DEBUG] [app] Starting request: urn:request:08073045-00bb-429a-9182-bf23b3823d2a (/v2/ibazulic/test-big-layers/blobs/sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc) gunicorn-registry stdout | 2022-05-05 11:03:34,626 [233] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,626 [233] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,626 [233] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,627 [231] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,628 [231] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,628 [231] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,629 [231] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,629 [233] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 34, 627761), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 34, 627801), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 34, 627830), datetime.datetime(2022, 4, 28, 11, 3, 34, 627846), None]) gunicorn-registry stdout | 2022-05-05 11:03:34,629 [231] [DEBUG] [app] Ending request: urn:request:b45a3ee8-a1f7-4e30-9d7d-a86f77cc0cc4 (/v2/ibazulic/test-big-layers/blobs/sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4) gunicorn-registry stdout | 2022-05-05 11:03:34,629 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,629 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,629 [233] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:34,630 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4 HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:27c726bebd645e5c59753ff7a4075494eeabbcf9c5c95669e5fcdf2bf4f532b4 HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.012 1360 0.012) gunicorn-registry stdout | 2022-05-05 11:03:34,631 [231] [DEBUG] [app] Starting request: urn:request:19c3303e-136a-456d-9b64-d4c37b59846c (/v2/ibazulic/test-big-layers/blobs/sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e) gunicorn-registry stdout | 2022-05-05 11:03:34,631 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,631 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,631 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,633 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,633 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,633 [246] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, 'a1f4061c-335a-4a7e-83a8-e483ea58ef53', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2022, 5, 5, 11, 3, 34, 629641)]) gunicorn-registry stdout | 2022-05-05 11:03:34,633 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,633 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,633 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,633 [231] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e_2 gunicorn-registry stdout | 2022-05-05 11:03:34,633 [231] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,634 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,637 [231] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,638 [231] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,639 [245] [DEBUG] [app] Starting request: urn:request:5d948f15-7899-47e2-b2f6-d596ec22fca6 (/v2/ibazulic/test-big-layers/blobs/sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9) gunicorn-registry stdout | 2022-05-05 11:03:34,639 [245] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,639 [245] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,639 [245] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,639 [246] [DEBUG] [app] Ending request: urn:request:d007670e-448d-4f98-b912-473d86622210 (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,640 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,640 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,641 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.031 1339 0.032) gunicorn-registry stdout | 2022-05-05 11:03:34,642 [231] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,642 [231] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,642 [231] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,643 [245] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,643 [231] [DEBUG] [app] Ending request: urn:request:19c3303e-136a-456d-9b64-d4c37b59846c (/v2/ibazulic/test-big-layers/blobs/sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e) gunicorn-registry stdout | 2022-05-05 11:03:34,642 [233] [DEBUG] [peewee.pool] Created new connection 140025709685488. gunicorn-registry stdout | 2022-05-05 11:03:34,643 [245] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,643 [245] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,643 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,643 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,644 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:34,643 [245] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,644 [245] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,645 [245] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9_2 nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:3e9942704944d6038666a8173a92fa4d7228d5098af5f4724a3ac10cd4171a7e HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.015 1360 0.016) gunicorn-registry stdout | 2022-05-05 11:03:34,645 [245] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,648 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,651 [233] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,651 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,651 [233] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,652 [233] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,652 [233] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,652 [233] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,652 [233] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc_2 gunicorn-registry stdout | 2022-05-05 11:03:34,653 [233] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:34,654 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,655 [233] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,655 [245] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,658 [245] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,658 [233] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,659 [245] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,660 [233] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,660 [245] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,660 [245] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,661 [245] [DEBUG] [app] Ending request: urn:request:5d948f15-7899-47e2-b2f6-d596ec22fca6 (/v2/ibazulic/test-big-layers/blobs/sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9) gunicorn-registry stdout | 2022-05-05 11:03:34,661 [245] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,661 [245] [DEBUG] [peewee.pool] Returning 140025700772288 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,661 [245] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9 HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:0983e930d0d0704b96c6a5aa8f46b6f33d451cc8b602cbca620cea8db6bc4cf9 HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.026 1360 0.028) gunicorn-registry stdout | 2022-05-05 11:03:34,661 [233] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,664 [233] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,665 [233] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,665 [233] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc_2: None gunicorn-registry stdout | 2022-05-05 11:03:34,666 [233] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:03:34,667 [233] [DEBUG] [app] Ending request: urn:request:08073045-00bb-429a-9182-bf23b3823d2a (/v2/ibazulic/test-big-layers/blobs/sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc) gunicorn-registry stdout | 2022-05-05 11:03:34,668 [233] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,668 [233] [DEBUG] [peewee.pool] Returning 140025709685488 to pool. nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.048 1360 0.048) gunicorn-registry stdout | 2022-05-05 11:03:34,668 [233] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:04f6ae7e4653529fbcf28a4bda8e722665ad45ef616975d2e8f1a901b7c427fc HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:34,698 [231] [DEBUG] [app] Starting request: urn:request:6d0ef907-3587-405b-ba71-01f928eb0acc (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,698 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,698 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,698 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,700 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,700 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,700 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,700 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,700 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,702 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,705 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,707 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "imagestoragelocation" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,709 [231] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, '0a9324c3-4fd6-4084-9e2b-259956c6abd4', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2022, 5, 5, 11, 3, 34, 708840)]) gunicorn-registry stdout | 2022-05-05 11:03:34,713 [246] [DEBUG] [app] Starting request: urn:request:762d600d-387e-4a47-9583-38d001fc98ac (/v2/ibazulic/test-big-layers/blobs/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53) gunicorn-registry stdout | 2022-05-05 11:03:34,714 [241] [DEBUG] [app] Starting request: urn:request:0a99256c-da51-4665-af8d-b49093bd1f70 (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,714 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': 'a1f4061c-335a-4a7e-83a8-e483ea58ef53', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,714 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,714 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,714 [241] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,714 [241] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,715 [241] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,715 [231] [DEBUG] [app] Ending request: urn:request:6d0ef907-3587-405b-ba71-01f928eb0acc (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,716 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,716 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,716 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,716 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,717 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,717 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,717 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,717 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.019 1339 0.020) gunicorn-registry stdout | 2022-05-05 11:03:34,719 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 34, 716487), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 34, 716528), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 34, 716554), datetime.datetime(2022, 4, 28, 11, 3, 34, 716567), None]) gunicorn-registry stdout | 2022-05-05 11:03:34,720 [241] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:34,720 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,723 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['a1f4061c-335a-4a7e-83a8-e483ea58ef53', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,725 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,725 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,729 [231] [DEBUG] [app] Starting request: urn:request:ecc441e2-393b-4e20-a43f-088c8ec836af (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,729 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,729 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,729 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,730 [241] [DEBUG] [peewee.pool] Created new connection 140025710706752. gunicorn-registry stdout | 2022-05-05 11:03:34,731 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,731 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,731 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,731 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,731 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,733 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,735 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,736 [246] [DEBUG] [app] Starting request: urn:request:6469a768-ac96-4331-bc86-4b1627438f65 (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,737 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,737 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,737 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,738 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,738 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,738 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,738 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,738 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,739 [241] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,739 [241] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,739 [241] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,739 [241] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,739 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,739 [241] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,742 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,742 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,742 [231] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, '00fa8baa-98e9-47b5-9993-723f35e1928b', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2022, 5, 5, 11, 3, 34, 741681)]) gunicorn-registry stdout | 2022-05-05 11:03:34,745 [246] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, 'd092eda1-db25-4693-9620-794c26a1f763', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2022, 5, 5, 11, 3, 34, 744527)]) gunicorn-registry stdout | 2022-05-05 11:03:34,745 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,747 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,747 [231] [DEBUG] [app] Ending request: urn:request:ecc441e2-393b-4e20-a43f-088c8ec836af (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,748 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,748 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,749 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.021 1339 0.020) gunicorn-registry stdout | 2022-05-05 11:03:34,749 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,750 [246] [DEBUG] [app] Ending request: urn:request:6469a768-ac96-4331-bc86-4b1627438f65 (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,750 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,751 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.015 1339 0.012) gunicorn-registry stdout | 2022-05-05 11:03:34,751 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:34,752 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "imagestoragelocation" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,754 [241] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, '549e0e07-adf1-447d-b311-ec894cdfd161', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2022, 5, 5, 11, 3, 34, 753896)]) gunicorn-registry stdout | 2022-05-05 11:03:34,760 [241] [DEBUG] [app] Ending request: urn:request:0a99256c-da51-4665-af8d-b49093bd1f70 (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:03:34,760 [241] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,761 [241] [DEBUG] [peewee.pool] Returning 140025710706752 to pool. nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.051 1339 0.052) gunicorn-registry stdout | 2022-05-05 11:03:34,761 [241] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:34 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:34,799 [246] [DEBUG] [app] Starting request: urn:request:5172f5c4-1028-464f-8302-b4830fe9d00f (/v2/ibazulic/test-big-layers/blobs/uploads/0a9324c3-4fd6-4084-9e2b-259956c6abd4) gunicorn-registry stdout | 2022-05-05 11:03:34,800 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '0a9324c3-4fd6-4084-9e2b-259956c6abd4', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,800 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,800 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,801 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,802 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,802 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,802 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,802 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,803 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,806 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['0a9324c3-4fd6-4084-9e2b-259956c6abd4', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,808 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,808 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,843 [231] [DEBUG] [app] Starting request: urn:request:45a1eaa1-af3f-42ca-9e73-2bc31d4f7eb8 (/v2/ibazulic/test-big-layers/blobs/uploads/549e0e07-adf1-447d-b311-ec894cdfd161) gunicorn-registry stdout | 2022-05-05 11:03:34,844 [245] [DEBUG] [app] Starting request: urn:request:327e9f82-a918-40fe-8e81-5af3dd285ab4 (/v2/ibazulic/test-big-layers/blobs/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b) gunicorn-registry stdout | 2022-05-05 11:03:34,844 [245] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '00fa8baa-98e9-47b5-9993-723f35e1928b', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,844 [245] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,844 [245] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,846 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '549e0e07-adf1-447d-b311-ec894cdfd161', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,846 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,846 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,847 [245] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,848 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,848 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,848 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,848 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,848 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,848 [245] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,848 [237] [DEBUG] [app] Starting request: urn:request:899e7851-3ba4-47ca-9743-46feb36b348d (/v2/ibazulic/test-big-layers/blobs/uploads/d092eda1-db25-4693-9620-794c26a1f763) gunicorn-registry stdout | 2022-05-05 11:03:34,848 [245] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,848 [245] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,848 [245] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,848 [237] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': 'd092eda1-db25-4693-9620-794c26a1f763', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:34,849 [237] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,849 [237] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:34,849 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,851 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,852 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['549e0e07-adf1-447d-b311-ec894cdfd161', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,853 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,853 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['00fa8baa-98e9-47b5-9993-723f35e1928b', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,853 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,853 [237] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 34, 851292), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 34, 851334), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 34, 851358), datetime.datetime(2022, 4, 28, 11, 3, 34, 851372), None]) gunicorn-registry stdout | 2022-05-05 11:03:34,854 [237] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:34,856 [245] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,856 [245] [DEBUG] [peewee.pool] Returning 140025700772288 to pool. gunicorn-registry stdout | 2022-05-05 11:03:34,863 [237] [DEBUG] [peewee.pool] Created new connection 140025710702960. gunicorn-registry stdout | 2022-05-05 11:03:34,872 [237] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:34,872 [237] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,872 [237] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:34,872 [237] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:34,872 [237] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:34,874 [237] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,878 [237] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:34,879 [237] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,881 [237] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['d092eda1-db25-4693-9620-794c26a1f763', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:34,884 [237] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:34,884 [237] [DEBUG] [peewee.pool] Returning 140025710702960 to pool. gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53?blockid=REDACTED&comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '585146' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '02130694-cc63-11ec-8f91-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,029 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:03:35,033 [246] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): quaystorageaccount2.blob.core.windows.net:443 gunicorn-registry stdout | 2022-05-05 11:03:35,136 [246] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53?blockid=MDAwMDA%3D&comp=block HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:03:35,137 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:03:35,137 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:35,137 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:03:35,137 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,137 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:35,138 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '06b6b9dd-501e-0046-666f-602311000000' gunicorn-registry stdout | 2022-05-05 11:03:35,138 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '02130694-cc63-11ec-8f91-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,138 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,138 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,138 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:34 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,139 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['a1f4061c-335a-4a7e-83a8-e483ea58ef53', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,141 [246] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, 'a1f4061c-335a-4a7e-83a8-e483ea58ef53', 585146, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3h2+fxeRfCwdfw3BJhoJdporXm8ziy0rVs/N/5xX9TLqdBtRwAAAAAA1d1r6N1n6czgnGlI3czcHjzIMs/gNy6FwBNYWx9/9oa44bPhs+Gz4fP/yOf/CwAA//+fP0kwAGIXAAAAAAAAADoAAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 1, 1532416, datetime.datetime(2022, 5, 5, 11, 3, 34, 629641), None, None, 1]) gunicorn-registry stdout | 2022-05-05 11:03:35,145 [246] [DEBUG] [app] Ending request: urn:request:762d600d-387e-4a47-9583-38d001fc98ac (/v2/ibazulic/test-big-layers/blobs/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53) gunicorn-registry stdout | 2022-05-05 11:03:35,145 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:35,146 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:03:35,146 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:35 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53 HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:35 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53 HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.468 586680 0.432) gunicorn-registry stdout | 2022-05-05 11:03:35,227 [231] [DEBUG] [app] Starting request: urn:request:985c2d86-1a1a-4a9e-8031-6f3eaa4145f5 (/v2/ibazulic/test-big-layers/blobs/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53) gunicorn-registry stdout | 2022-05-05 11:03:35,227 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': 'a1f4061c-335a-4a7e-83a8-e483ea58ef53', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:35,227 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:35,227 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:35,229 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:35,229 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:35,229 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:35,229 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:35,229 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:35,230 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,233 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['a1f4061c-335a-4a7e-83a8-e483ea58ef53', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,234 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:35,234 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:35,235 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['a1f4061c-335a-4a7e-83a8-e483ea58ef53', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,237 [231] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, 'a1f4061c-335a-4a7e-83a8-e483ea58ef53', 585146, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3h2+fxeRfCwdfw3BJhoJdporXm8ziy0rVs/N/5xX9TLqdBtRwAAAAAA1d1r6N1n6czgnGlI3czcHjzIMs/gNy6FwBNYWx9/9oa44bPhs+Gz4fP/yOf/CwAA//+fP0kwAGIXAAAAAAAAADoAAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 2, 1532416, datetime.datetime(2022, 5, 5, 11, 3, 34, 629641), None, None, 1]) gunicorn-registry stdout | 2022-05-05 11:03:35,241 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:35,241 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1' gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '02340e34-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,244 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:03:35,248 [231] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): quaystorageaccount2.blob.core.windows.net:443 gunicorn-registry stdout | 2022-05-05 11:03:35,332 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 404 0 gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 404 gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Transfer-Encoding': 'chunked' gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75541e-401e-0065-1e6f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '02340e34-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-error-code': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,333 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:34 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,335 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53?comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,335 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:03:35,335 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:35,335 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/xml; charset=utf-8' gunicorn-registry stdout | 2022-05-05 11:03:35,335 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,336 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-content-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,336 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '87' gunicorn-registry stdout | 2022-05-05 11:03:35,336 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,336 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '02420b56-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,336 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:35,336 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,336 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:03:35,346 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53?comp=blocklist HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:03:35 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86E677D073"' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b755425-401e-0065-236f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '02420b56-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-content-crc64': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,347 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:34 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '0244193c-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,349 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:03:35,387 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:03:35 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86E67DEA77"' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75542c-401e-0065-2a6f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '0244193c-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:34 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1' gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '024a5a36-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:03:35,394 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 200 0 gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 200 gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '585146' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:03:35 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Accept-Ranges': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86E67DEA77"' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75544d-401e-0065-486f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '024a5a36-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-creation-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-state': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-progress': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,395 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-completion-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier-inferred': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:34 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,396 [231] [DEBUG] [storage.azurestorage] Deleting chunked upload a1f4061c-335a-4a7e-83a8-e483ea58ef53 at path registry/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53 gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53' gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'DELETE' gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '024b81c2-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,397 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:03:35,404 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "DELETE /quayblobstorage/registry/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53 HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b755454-401e-0065-4d6f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '024b81c2-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-delete-type-permanent': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:35,405 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:34 GMT' gunicorn-registry stdout | 2022-05-05 11:03:35,406 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['a1f4061c-335a-4a7e-83a8-e483ea58ef53', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,408 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."image_size", "t1"."uncompressed_size", "t1"."uploading", "t1"."cas_path", "t1"."content_checksum" FROM "imagestorage" AS "t1" WHERE ("t1"."content_checksum" = %s) LIMIT %s OFFSET %s', ['sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,409 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorage" ("uuid", "image_size", "uncompressed_size", "uploading", "cas_path", "content_checksum") VALUES (%s, %s, %s, %s, %s, %s) RETURNING "imagestorage"."id"', ['216280f0-8d80-405f-909c-059c4a97994d', 585146, 1532416, True, True, 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1']) gunicorn-registry stdout | 2022-05-05 11:03:35,410 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorageplacement" ("storage_id", "location_id") VALUES (%s, %s) RETURNING "imagestorageplacement"."id"', [1, 9]) gunicorn-registry stdout | 2022-05-05 11:03:35,412 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,412 [231] [DEBUG] [peewee] ('INSERT INTO "uploadedblob" ("repository_id", "blob_id", "uploaded_at", "expires_at") VALUES (%s, %s, %s, %s) RETURNING "uploadedblob"."id"', [1, 1, datetime.datetime(2022, 5, 5, 11, 3, 35, 412681), datetime.datetime(2022, 5, 5, 12, 3, 35, 412669)]) gunicorn-registry stdout | 2022-05-05 11:03:35,414 [231] [DEBUG] [peewee] ('DELETE FROM "blobupload" WHERE ("blobupload"."id" = %s)', [1]) gunicorn-registry stdout | 2022-05-05 11:03:35,418 [231] [DEBUG] [app] Ending request: urn:request:985c2d86-1a1a-4a9e-8031-6f3eaa4145f5 (/v2/ibazulic/test-big-layers/blobs/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53) gunicorn-registry stdout | 2022-05-05 11:03:35,418 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:35,418 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:35,419 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:35 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53?digest=sha256%3A93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:35 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/a1f4061c-335a-4a7e-83a8-e483ea58ef53?digest=sha256%3A93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.192 1455 0.192) gunicorn-registry stdout | 2022-05-05 11:03:35,505 [246] [DEBUG] [app] Starting request: urn:request:cdf594f1-b42e-48f8-bc76-9ba1c6115c53 (/v2/ibazulic/test-big-layers/blobs/sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1) gunicorn-registry stdout | 2022-05-05 11:03:35,506 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:35,506 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:35,506 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:35,507 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:35,508 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:35,508 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:35,508 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:35,508 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:35,508 [246] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2 gunicorn-registry stdout | 2022-05-05 11:03:35,508 [246] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:35,509 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,511 [246] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:35,513 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id", "t2"."id", "t2"."uuid", "t2"."image_size", "t2"."uncompressed_size", "t2"."uploading", "t2"."cas_path", "t2"."content_checksum" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['216280f0-8d80-405f-909c-059c4a97994d']) gunicorn-registry stdout | 2022-05-05 11:03:35,515 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['216280f0-8d80-405f-909c-059c4a97994d']) gunicorn-registry stdout | 2022-05-05 11:03:35,516 [246] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2: {'uuid': '216280f0-8d80-405f-909c-059c4a97994d', 'digest': 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 'compressed_size': 585146, 'uncompressed_size': 1532416, 'uploading': True, 'db_id': 1, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1'}} gunicorn-registry stdout | 2022-05-05 11:03:35,516 [246] [DEBUG] [data.cache.impl] Caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2 with expiration {'uuid': '216280f0-8d80-405f-909c-059c4a97994d', 'digest': 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 'compressed_size': 585146, 'uncompressed_size': 1532416, 'uploading': True, 'db_id': 1, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1'}}: 60s gunicorn-registry stdout | 2022-05-05 11:03:35,516 [246] [DEBUG] [data.cache.impl] Cached loaded result for key repo_blob__ibazulic_test-big-layers_sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1_2 with expiration {'uuid': '216280f0-8d80-405f-909c-059c4a97994d', 'digest': 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 'compressed_size': 585146, 'uncompressed_size': 1532416, 'uploading': True, 'db_id': 1, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/93/93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1'}}: 60s gunicorn-registry stdout | 2022-05-05 11:03:35,517 [246] [DEBUG] [app] Ending request: urn:request:cdf594f1-b42e-48f8-bc76-9ba1c6115c53 (/v2/ibazulic/test-big-layers/blobs/sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1) gunicorn-registry stdout | 2022-05-05 11:03:35,517 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:35,517 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:03:35,517 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:35 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:35 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1 HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.013 1360 0.012) notificationworker stdout | 2022-05-05 11:03:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:03:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:45.685352+00:00 (in 9.999450 seconds) notificationworker stdout | 2022-05-05 11:03:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:45 UTC)" (scheduled at 2022-05-05 11:03:35.685352+00:00) notificationworker stdout | 2022-05-05 11:03:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:03:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 35, 686413), True, datetime.datetime(2022, 5, 5, 11, 3, 35, 686413), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:03:35,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:03:35,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:03:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/d092eda1-db25-4693-9620-794c26a1f763?blockid=REDACTED&comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '13736270' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '04268e4c-cc63-11ec-8b32-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,539 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:03:38,543 [237] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): quaystorageaccount2.blob.core.windows.net:443 namespacegcworker stdout | 2022-05-05 11:03:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:03:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:09.794132+00:00 (in 31.088356 seconds) namespacegcworker stdout | 2022-05-05 11:03:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:38 UTC)" (scheduled at 2022-05-05 11:03:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:03:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:03:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 38, 706345), True, datetime.datetime(2022, 5, 5, 11, 3, 38, 706345), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:03:38,723 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:03:38,723 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:03:38,723 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:03:38,770 [237] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/d092eda1-db25-4693-9620-794c26a1f763?blockid=MDAwMDA%3D&comp=block HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': 'ff157a3e-e01e-0043-096f-60f1ca000000' gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '04268e4c-cc63-11ec-8b32-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,771 [237] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:37 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,773 [237] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['d092eda1-db25-4693-9620-794c26a1f763', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:38,775 [237] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, 'd092eda1-db25-4693-9620-794c26a1f763', 13736270, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3gfGBjJuWwHJ/uPPlr66jOyEx8mzqbU0A6sryvHTJT5G3DKjAYAAAAA/xUAAP//5CFJRgAcDwEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA4AAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 1, 17767424, datetime.datetime(2022, 5, 5, 11, 3, 34, 744527), None, None, 4]) gunicorn-registry stdout | 2022-05-05 11:03:38,782 [237] [DEBUG] [app] Ending request: urn:request:899e7851-3ba4-47ca-9743-46feb36b348d (/v2/ibazulic/test-big-layers/blobs/uploads/d092eda1-db25-4693-9620-794c26a1f763) gunicorn-registry stdout | 2022-05-05 11:03:38,782 [237] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:38,783 [237] [DEBUG] [peewee.pool] Returning 140025710702960 to pool. gunicorn-registry stdout | 2022-05-05 11:03:38,783 [237] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:38 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/d092eda1-db25-4693-9620-794c26a1f763 HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:38 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/d092eda1-db25-4693-9620-794c26a1f763 HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (4.011 13741020 3.940) gunicorn-registry stdout | 2022-05-05 11:03:38,916 [231] [DEBUG] [app] Starting request: urn:request:37211b27-9d3e-4c99-920e-9efbe89a4d67 (/v2/ibazulic/test-big-layers/blobs/uploads/d092eda1-db25-4693-9620-794c26a1f763) gunicorn-registry stdout | 2022-05-05 11:03:38,916 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': 'd092eda1-db25-4693-9620-794c26a1f763', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:38,916 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:38,916 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:38,918 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:38,918 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:38,918 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:38,918 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:38,918 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:38,919 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:38,922 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['d092eda1-db25-4693-9620-794c26a1f763', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:38,924 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:38,924 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:38,925 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['d092eda1-db25-4693-9620-794c26a1f763', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:38,927 [231] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, 'd092eda1-db25-4693-9620-794c26a1f763', 13736270, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3gfGBjJuWwHJ/uPPlr66jOyEx8mzqbU0A6sryvHTJT5G3DKjAYAAAAA/xUAAP//5CFJRgAcDwEAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA4AAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 2, 17767424, datetime.datetime(2022, 5, 5, 11, 3, 34, 744527), None, None, 4]) gunicorn-registry stdout | 2022-05-05 11:03:38,930 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:38,930 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1' gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '0466aedc-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,931 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:03:38,936 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 404 0 gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 404 gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Transfer-Encoding': 'chunked' gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b755c1f-401e-0065-3e6f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '0466aedc-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-error-code': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,937 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:38 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/d092eda1-db25-4693-9620-794c26a1f763?comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/xml; charset=utf-8' gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-content-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '87' gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,938 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '0467d0e6-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,939 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:38,939 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,939 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:03:38,949 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/d092eda1-db25-4693-9620-794c26a1f763?comp=blocklist HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:03:38,949 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:03:38,949 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:38,949 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:03:38,949 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:03:38 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,949 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86E89D8FE4"' gunicorn-registry stdout | 2022-05-05 11:03:38,950 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:38,950 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b755c21-401e-0065-406f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:38,950 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '0467d0e6-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,950 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,950 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-content-crc64': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,950 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,950 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:38 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,951 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1' gunicorn-registry stdout | 2022-05-05 11:03:38,951 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:03:38,951 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:38,951 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,951 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,951 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,951 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '0469c784-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,952 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:38,952 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,952 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:03:38,970 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:03:38,971 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:03:38,971 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:38,971 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:03:38,971 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:03:38 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,971 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86E8A09CEB"' gunicorn-registry stdout | 2022-05-05 11:03:38,971 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:38,972 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b755c2a-401e-0065-486f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:38,972 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '0469c784-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,972 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,972 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,972 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,972 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:38 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1' gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '046d26c2-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,973 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 200 0 gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 200 gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '13736270' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:03:38 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Accept-Ranges': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86E8A09CEB"' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b755c3c-401e-0065-586f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '046d26c2-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-creation-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-state': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,978 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-progress': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-completion-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier-inferred': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:38 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,979 [231] [DEBUG] [storage.azurestorage] Deleting chunked upload d092eda1-db25-4693-9620-794c26a1f763 at path registry/uploads/d092eda1-db25-4693-9620-794c26a1f763 gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/d092eda1-db25-4693-9620-794c26a1f763' gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'DELETE' gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '046e3814-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,980 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:03:38,989 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "DELETE /quayblobstorage/registry/uploads/d092eda1-db25-4693-9620-794c26a1f763 HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:03:38,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:03:38,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:03:38,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:03:38,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:03:38,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b755c43-401e-0065-5f6f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:03:38,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '046e3814-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:03:38,990 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,990 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-delete-type-permanent': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:03:38,990 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:03:38 GMT' gunicorn-registry stdout | 2022-05-05 11:03:38,990 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['d092eda1-db25-4693-9620-794c26a1f763', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:38,994 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."image_size", "t1"."uncompressed_size", "t1"."uploading", "t1"."cas_path", "t1"."content_checksum" FROM "imagestorage" AS "t1" WHERE ("t1"."content_checksum" = %s) LIMIT %s OFFSET %s', ['sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:38,995 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorage" ("uuid", "image_size", "uncompressed_size", "uploading", "cas_path", "content_checksum") VALUES (%s, %s, %s, %s, %s, %s) RETURNING "imagestorage"."id"', ['981beaef-8324-486f-abdb-26f2a1aac196', 13736270, 17767424, True, True, 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1']) gunicorn-registry stdout | 2022-05-05 11:03:38,995 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorageplacement" ("storage_id", "location_id") VALUES (%s, %s) RETURNING "imagestorageplacement"."id"', [2, 9]) gunicorn-registry stdout | 2022-05-05 11:03:38,996 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:38,997 [231] [DEBUG] [peewee] ('INSERT INTO "uploadedblob" ("repository_id", "blob_id", "uploaded_at", "expires_at") VALUES (%s, %s, %s, %s) RETURNING "uploadedblob"."id"', [1, 2, datetime.datetime(2022, 5, 5, 11, 3, 38, 997576), datetime.datetime(2022, 5, 5, 12, 3, 38, 997564)]) gunicorn-registry stdout | 2022-05-05 11:03:38,998 [231] [DEBUG] [peewee] ('DELETE FROM "blobupload" WHERE ("blobupload"."id" = %s)', [4]) gunicorn-registry stdout | 2022-05-05 11:03:39,002 [231] [DEBUG] [app] Ending request: urn:request:37211b27-9d3e-4c99-920e-9efbe89a4d67 (/v2/ibazulic/test-big-layers/blobs/uploads/d092eda1-db25-4693-9620-794c26a1f763) gunicorn-registry stdout | 2022-05-05 11:03:39,002 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:39,002 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:39 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/d092eda1-db25-4693-9620-794c26a1f763?digest=sha256%3A8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.088 1455 0.088) gunicorn-registry stdout | 2022-05-05 11:03:39,003 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:38 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/d092eda1-db25-4693-9620-794c26a1f763?digest=sha256%3A8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:03:39,161 [243] [DEBUG] [app] Starting request: urn:request:83b361ca-ad1d-4051-807d-5832e206180c (/v2/ibazulic/test-big-layers/blobs/sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1) gunicorn-registry stdout | 2022-05-05 11:03:39,162 [243] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:03:39,162 [243] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:39,162 [243] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:03:39,165 [243] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE ((((NOT ("t1"."approval_id" IS %s) AND (("t1"."expiration_date" > %s) OR ("t1"."expiration_date" IS %s))) AND ("t1"."service" = %s)) AND (NOT (("t1"."service" = %s) AND ("t1"."expiration_date" <= %s)) OR NOT ((("t1"."service" = %s) AND ("t1"."approval_id" IS %s)) AND ("t1"."created_date" <= %s)))) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s)))', [None, datetime.datetime(2022, 5, 5, 11, 3, 39, 164155), None, 'quay', 'quay', datetime.datetime(2022, 5, 5, 11, 3, 39, 164203), 'quay', None, datetime.datetime(2022, 5, 4, 11, 3, 39, 164230), datetime.datetime(2022, 4, 28, 11, 3, 39, 164247), None]) gunicorn-registry stdout | 2022-05-05 11:03:39,166 [243] [DEBUG] [peewee.pool] No connection available in pool. gunicorn-registry stdout | 2022-05-05 11:03:39,175 [243] [DEBUG] [peewee.pool] Created new connection 140025710716160. gunicorn-registry stdout | 2022-05-05 11:03:39,184 [243] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:03:39,184 [243] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:03:39,184 [243] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:03:39,185 [243] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:03:39,185 [243] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:03:39,185 [243] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2 gunicorn-registry stdout | 2022-05-05 11:03:39,186 [243] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2; calling loader gunicorn-registry stdout | 2022-05-05 11:03:39,188 [243] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:39,191 [243] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "repositorykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:39,192 [243] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "visibility" AS "t1" WHERE ("t1"."name" = %s) LIMIT %s OFFSET %s', ['public', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:39,194 [243] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:03:39,196 [243] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id", "t2"."id", "t2"."uuid", "t2"."image_size", "t2"."uncompressed_size", "t2"."uploading", "t2"."cas_path", "t2"."content_checksum" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['981beaef-8324-486f-abdb-26f2a1aac196']) gunicorn-registry stdout | 2022-05-05 11:03:39,198 [243] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "imagestoragelocation" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:03:39,199 [243] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['981beaef-8324-486f-abdb-26f2a1aac196']) gunicorn-registry stdout | 2022-05-05 11:03:39,200 [243] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2: {'uuid': '981beaef-8324-486f-abdb-26f2a1aac196', 'digest': 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 'compressed_size': 13736270, 'uncompressed_size': 17767424, 'uploading': True, 'db_id': 2, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1'}} gunicorn-registry stdout | 2022-05-05 11:03:39,200 [243] [DEBUG] [data.cache.impl] Caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2 with expiration {'uuid': '981beaef-8324-486f-abdb-26f2a1aac196', 'digest': 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 'compressed_size': 13736270, 'uncompressed_size': 17767424, 'uploading': True, 'db_id': 2, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1'}}: 60s gunicorn-registry stdout | 2022-05-05 11:03:39,201 [243] [DEBUG] [data.cache.impl] Cached loaded result for key repo_blob__ibazulic_test-big-layers_sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1_2 with expiration {'uuid': '981beaef-8324-486f-abdb-26f2a1aac196', 'digest': 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 'compressed_size': 13736270, 'uncompressed_size': 17767424, 'uploading': True, 'db_id': 2, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/86/8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1'}}: 60s gunicorn-registry stdout | 2022-05-05 11:03:39,203 [243] [DEBUG] [app] Ending request: urn:request:83b361ca-ad1d-4051-807d-5832e206180c (/v2/ibazulic/test-big-layers/blobs/sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1) gunicorn-registry stdout | 2022-05-05 11:03:39,203 [243] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:03:39,203 [243] [DEBUG] [peewee.pool] Returning 140025710716160 to pool. gunicorn-registry stdout | 2022-05-05 11:03:39,204 [243] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:03:39 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:03:39 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1 HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.046 1360 0.044) notificationworker stdout | 2022-05-05 11:03:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:03:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:55.685352+00:00 (in 9.999476 seconds) notificationworker stdout | 2022-05-05 11:03:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:55 UTC)" (scheduled at 2022-05-05 11:03:45.685352+00:00) notificationworker stdout | 2022-05-05 11:03:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:03:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 45, 686410), True, datetime.datetime(2022, 5, 5, 11, 3, 45, 686410), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:03:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:03:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:03:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:03:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:03:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:03:46,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:16.265236+00:00 (in 29.999433 seconds) buildlogsarchiver stdout | 2022-05-05 11:03:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:04:16 UTC)" (scheduled at 2022-05-05 11:03:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:03:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 3, 46, 266319), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:03:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:03:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:03:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:04:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:03:47,517 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:03:47,517 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:49.523944+00:00 (in 2.006794 seconds) repositorygcworker stdout | 2022-05-05 11:03:47,517 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:08:47 UTC)" (scheduled at 2022-05-05 11:03:47.516588+00:00) repositorygcworker stdout | 2022-05-05 11:03:47,518 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 3, 47, 517627), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:03:47,529 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 3, 47, 517627), True, datetime.datetime(2022, 5, 5, 11, 3, 47, 517627), 0, 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:03:47,533 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 3, 47, 517627), True, datetime.datetime(2022, 5, 5, 11, 3, 47, 517627), 0, 'repositorygc/%', False, datetime.datetime(2022, 5, 5, 11, 3, 47, 517627), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:03:47,536 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:03:47,536 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:08:47 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:03:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:03:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:03:51.436849+00:00 (in 1.912386 seconds) repositorygcworker stdout | 2022-05-05 11:03:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:49 UTC)" (scheduled at 2022-05-05 11:03:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:03:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:03:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:03:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:03:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:49.523944+00:00 (in 58.086416 seconds) repositorygcworker stdout | 2022-05-05 11:03:51,438 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:51 UTC)" (scheduled at 2022-05-05 11:03:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:03:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:03:51,441 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 51, 438199), True, datetime.datetime(2022, 5, 5, 11, 3, 51, 438199), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:03:51,452 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:03:51,452 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:03:51,452 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:04:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:03:52,515 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:03:52,782 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:03:52,801 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:03:52,812 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositoryactioncounter stdout | 2022-05-05 11:03:52,900 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:03:52,912 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:03:52,917 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} notificationworker stdout | 2022-05-05 11:03:52,950 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:03:52,996 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:03:53,040 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:03:53,080 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:03:53,113 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:03:53,157 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:03:53,194 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:03:53,200 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:03:53,274 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:03:53,285 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:03:53,462 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:03:53,521 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:03:54,310 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:03:54,316 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:03:54,321 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:03:54,328 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-secscan stdout | 2022-05-05 11:03:54,333 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-web stdout | 2022-05-05 11:03:54,371 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:03:54,378 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:03:54,386 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:03:54,391 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:03:54,396 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:03:54,404 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:03:54,409 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:03:54,415 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:03:54,420 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:03:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:03:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:05.685352+00:00 (in 9.999467 seconds) notificationworker stdout | 2022-05-05 11:03:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:05 UTC)" (scheduled at 2022-05-05 11:03:55.685352+00:00) notificationworker stdout | 2022-05-05 11:03:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:03:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 3, 55, 686426), True, datetime.datetime(2022, 5, 5, 11, 3, 55, 686426), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:03:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:03:55,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:03:55,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:03:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:03:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:28.857216+00:00 (in 29.999392 seconds) gcworker stdout | 2022-05-05 11:03:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:04:28 UTC)" (scheduled at 2022-05-05 11:03:58.857216+00:00) gcworker stdout | 2022-05-05 11:03:58,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:03:58,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:04:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:04:00,132 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:04:00,153 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:04:00,163 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:04:00,172 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:04:00,177 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:04:00,182 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:04:00,187 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:04:00,193 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:04:00,199 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:04:00,204 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:04:00,211 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:04:00,216 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:04:00,225 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:04:00,230 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:04:00,238 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:04:00,243 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:04:00,247 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:04:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:04:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:15.685352+00:00 (in 9.999406 seconds) notificationworker stdout | 2022-05-05 11:04:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:15 UTC)" (scheduled at 2022-05-05 11:04:05.685352+00:00) notificationworker stdout | 2022-05-05 11:04:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:04:05,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 5, 686599), True, datetime.datetime(2022, 5, 5, 11, 4, 5, 686599), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:04:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:04:05,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:04:05,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:04:06,407 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/549e0e07-adf1-447d-b311-ec894cdfd161?blockid=REDACTED&comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:06,407 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:04:06,407 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:04:06,407 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:04:06,407 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '54941777' gunicorn-registry stdout | 2022-05-05 11:04:06,407 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:06,407 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:06,408 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '14b5e8b6-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:06,408 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:04:06,408 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:06,408 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:06,408 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:04:06,958 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/549e0e07-adf1-447d-b311-ec894cdfd161?blockid=MDAwMDA%3D&comp=block HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:04:06,958 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:04:06,958 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:04:06,958 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:04:06,959 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:06,959 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:04:06,959 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75a7c6-401e-0065-556f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:04:06,959 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '14b5e8b6-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:06,959 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:06,959 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:06,959 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:04:06 GMT' gunicorn-registry stdout | 2022-05-05 11:04:06,960 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['549e0e07-adf1-447d-b311-ec894cdfd161', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:06,964 [231] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '549e0e07-adf1-447d-b311-ec894cdfd161', 54941777, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3jV0+BkhkyNqT11khTTzS7acKN6LOI4tUCgdUIzA0PzWojCMhoAAAAAOZny/wIAAP//3N4xrAAgsgcAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABEAAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 1, 129114112, datetime.datetime(2022, 5, 5, 11, 3, 34, 753896), None, None, 5]) gunicorn-registry stdout | 2022-05-05 11:04:06,974 [231] [DEBUG] [app] Ending request: urn:request:45a1eaa1-af3f-42ca-9e73-2bc31d4f7eb8 (/v2/ibazulic/test-big-layers/blobs/uploads/549e0e07-adf1-447d-b311-ec894cdfd161) gunicorn-registry stdout | 2022-05-05 11:04:06,974 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:04:06,974 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:04:06,975 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:04:06 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/549e0e07-adf1-447d-b311-ec894cdfd161 HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:04:07 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/549e0e07-adf1-447d-b311-ec894cdfd161 HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (32.255 54956583 32.132) gunicorn-registry stdout | 2022-05-05 11:04:07,322 [231] [DEBUG] [app] Starting request: urn:request:7b4feb0e-b423-463b-9a38-91cb560b915d (/v2/ibazulic/test-big-layers/blobs/uploads/549e0e07-adf1-447d-b311-ec894cdfd161) gunicorn-registry stdout | 2022-05-05 11:04:07,322 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '549e0e07-adf1-447d-b311-ec894cdfd161', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:04:07,322 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:04:07,322 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:04:07,324 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:04:07,324 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:04:07,324 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:04:07,324 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:04:07,324 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:04:07,325 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:07,328 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['549e0e07-adf1-447d-b311-ec894cdfd161', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:07,329 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:04:07,329 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:04:07,330 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['549e0e07-adf1-447d-b311-ec894cdfd161', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:07,331 [231] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '549e0e07-adf1-447d-b311-ec894cdfd161', 54941777, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3jV0+BkhkyNqT11khTTzS7acKN6LOI4tUCgdUIzA0PzWojCMhoAAAAAOZny/wIAAP//3N4xrAAgsgcAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAABEAAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 2, 129114112, datetime.datetime(2022, 5, 5, 11, 3, 34, 753896), None, None, 5]) gunicorn-registry stdout | 2022-05-05 11:04:07,341 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:04:07,342 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a' gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '1555fa22-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,343 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 404 0 gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 404 gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Transfer-Encoding': 'chunked' gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75aa34-401e-0065-6e6f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '1555fa22-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-error-code': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,348 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:04:06 GMT' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/549e0e07-adf1-447d-b311-ec894cdfd161?comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/xml; charset=utf-8' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-content-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '87' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '1557129a-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,350 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:04:07,361 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/549e0e07-adf1-447d-b311-ec894cdfd161?comp=blocklist HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:04:07,361 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:04:07,361 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:04:07 GMT' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86F98CDA2F"' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75aa3e-401e-0065-786f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '1557129a-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-content-crc64': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,362 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:04:06 GMT' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '155930ca-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,364 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:04:07,388 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:04:07,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:04:07,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:04:07,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:04:07,388 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:04:07 GMT' gunicorn-registry stdout | 2022-05-05 11:04:07,389 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86F990AA74"' gunicorn-registry stdout | 2022-05-05 11:04:07,389 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:04:07,389 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75aa46-401e-0065-806f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:04:07,389 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '155930ca-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,389 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,389 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,389 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,389 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:04:06 GMT' gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a' gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '155d38d2-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,390 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:04:07,395 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 200 0 gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 200 gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '54941777' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:04:07 GMT' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Accept-Ranges': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E86F990AA74"' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75aa52-401e-0065-0c6f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '155d38d2-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-creation-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-state': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-progress': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-completion-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier-inferred': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,396 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:04:06 GMT' gunicorn-registry stdout | 2022-05-05 11:04:07,397 [231] [DEBUG] [storage.azurestorage] Deleting chunked upload 549e0e07-adf1-447d-b311-ec894cdfd161 at path registry/uploads/549e0e07-adf1-447d-b311-ec894cdfd161 gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/549e0e07-adf1-447d-b311-ec894cdfd161' gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'DELETE' gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '155e6ad6-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,398 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:04:07,405 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "DELETE /quayblobstorage/registry/uploads/549e0e07-adf1-447d-b311-ec894cdfd161 HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9b75aa58-401e-0065-116f-60b9d2000000' gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '155e6ad6-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-delete-type-permanent': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:04:07,406 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:04:06 GMT' gunicorn-registry stdout | 2022-05-05 11:04:07,407 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['549e0e07-adf1-447d-b311-ec894cdfd161', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:07,409 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."image_size", "t1"."uncompressed_size", "t1"."uploading", "t1"."cas_path", "t1"."content_checksum" FROM "imagestorage" AS "t1" WHERE ("t1"."content_checksum" = %s) LIMIT %s OFFSET %s', ['sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:07,410 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorage" ("uuid", "image_size", "uncompressed_size", "uploading", "cas_path", "content_checksum") VALUES (%s, %s, %s, %s, %s, %s) RETURNING "imagestorage"."id"', ['052be543-e046-4d8b-9373-c99be48b3f95', 54941777, 129114112, True, True, 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a']) gunicorn-registry stdout | 2022-05-05 11:04:07,411 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorageplacement" ("storage_id", "location_id") VALUES (%s, %s) RETURNING "imagestorageplacement"."id"', [3, 9]) gunicorn-registry stdout | 2022-05-05 11:04:07,412 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:07,413 [231] [DEBUG] [peewee] ('INSERT INTO "uploadedblob" ("repository_id", "blob_id", "uploaded_at", "expires_at") VALUES (%s, %s, %s, %s) RETURNING "uploadedblob"."id"', [1, 3, datetime.datetime(2022, 5, 5, 11, 4, 7, 413585), datetime.datetime(2022, 5, 5, 12, 4, 7, 413573)]) gunicorn-registry stdout | 2022-05-05 11:04:07,414 [231] [DEBUG] [peewee] ('DELETE FROM "blobupload" WHERE ("blobupload"."id" = %s)', [5]) gunicorn-registry stdout | 2022-05-05 11:04:07,418 [231] [DEBUG] [app] Ending request: urn:request:7b4feb0e-b423-463b-9a38-91cb560b915d (/v2/ibazulic/test-big-layers/blobs/uploads/549e0e07-adf1-447d-b311-ec894cdfd161) gunicorn-registry stdout | 2022-05-05 11:04:07,418 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:04:07,418 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:04:07,419 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:04:07 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/549e0e07-adf1-447d-b311-ec894cdfd161?digest=sha256%3A6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:04:07 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/549e0e07-adf1-447d-b311-ec894cdfd161?digest=sha256%3A6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.098 1455 0.096) gunicorn-registry stdout | 2022-05-05 11:04:07,788 [231] [DEBUG] [app] Starting request: urn:request:12e36d44-3372-429b-9c8f-53eadb2ce638 (/v2/ibazulic/test-big-layers/blobs/sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a) gunicorn-registry stdout | 2022-05-05 11:04:07,789 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:04:07,789 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:04:07,789 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4NjE0LCJpYXQiOjE2NTE3NDg2MTQsImV4cCI6MTY1MTc1MjIxNCwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.cWtb7KMivB9xPjPuGklT3TP14Vd8uiOreN4CTf347bWUQT_o0jcRpJI7AgIJm2fh8FXTXHCCNTVsGszoQy-mqJb4DlNV_VpGi3Akz7gD0qPIC2Nwk6zaF6PA9PHd9h4Y3bzmBijBoJORiuvOx_xkXdi0UsoDKl6vK12OP_S977wIEdmxpyYuV941qpxuYTcUceYflZVBDgH1eButAMg8S5Ty8BCNReO8jhRbj25k6Xv1tJG0OJN4re0E6xpVRSD_r9xo8UVTplKhWBLKpqATkRIaX_oVa1xCHuMO_m2BpQpTs0HNOdJbS6fjYnGQT-1wvG5-FfEpMtYcEFYdx1JRgw gunicorn-registry stdout | 2022-05-05 11:04:07,790 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:04:07,790 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:04:07,790 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:04:07,790 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:04:07,790 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:04:07,791 [231] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2 gunicorn-registry stdout | 2022-05-05 11:04:07,791 [231] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2; calling loader gunicorn-registry stdout | 2022-05-05 11:04:07,792 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:07,794 [231] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:04:07,796 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id", "t2"."id", "t2"."uuid", "t2"."image_size", "t2"."uncompressed_size", "t2"."uploading", "t2"."cas_path", "t2"."content_checksum" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['052be543-e046-4d8b-9373-c99be48b3f95']) gunicorn-registry stdout | 2022-05-05 11:04:07,797 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['052be543-e046-4d8b-9373-c99be48b3f95']) gunicorn-registry stdout | 2022-05-05 11:04:07,798 [231] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2: {'uuid': '052be543-e046-4d8b-9373-c99be48b3f95', 'digest': 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 'compressed_size': 54941777, 'uncompressed_size': 129114112, 'uploading': True, 'db_id': 3, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a'}} gunicorn-registry stdout | 2022-05-05 11:04:07,798 [231] [DEBUG] [data.cache.impl] Caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2 with expiration {'uuid': '052be543-e046-4d8b-9373-c99be48b3f95', 'digest': 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 'compressed_size': 54941777, 'uncompressed_size': 129114112, 'uploading': True, 'db_id': 3, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a'}}: 60s gunicorn-registry stdout | 2022-05-05 11:04:07,799 [231] [DEBUG] [data.cache.impl] Cached loaded result for key repo_blob__ibazulic_test-big-layers_sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a_2 with expiration {'uuid': '052be543-e046-4d8b-9373-c99be48b3f95', 'digest': 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 'compressed_size': 54941777, 'uncompressed_size': 129114112, 'uploading': True, 'db_id': 3, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/6a/6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a'}}: 60s gunicorn-registry stdout | 2022-05-05 11:04:07,799 [231] [DEBUG] [app] Ending request: urn:request:12e36d44-3372-429b-9c8f-53eadb2ce638 (/v2/ibazulic/test-big-layers/blobs/sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a) gunicorn-registry stdout | 2022-05-05 11:04:07,800 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:04:07,800 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:04:07,800 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:04:07 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:04:07 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.013 1360 0.012) namespacegcworker stdout | 2022-05-05 11:04:09,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:04:09,794 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:32.794430+00:00 (in 22.999668 seconds) namespacegcworker stdout | 2022-05-05 11:04:09,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:09:09 UTC)" (scheduled at 2022-05-05 11:04:09.794132+00:00) namespacegcworker stdout | 2022-05-05 11:04:09,796 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 4, 9, 795355), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:04:09,808 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 4, 9, 795355), True, datetime.datetime(2022, 5, 5, 11, 4, 9, 795355), 0, 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:04:09,811 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 4, 9, 795355), True, datetime.datetime(2022, 5, 5, 11, 4, 9, 795355), 0, 'namespacegc/%', False, datetime.datetime(2022, 5, 5, 11, 4, 9, 795355), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:04:09,813 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:04:09,813 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:09:09 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:04:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:04:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:25.685352+00:00 (in 9.999377 seconds) notificationworker stdout | 2022-05-05 11:04:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:25 UTC)" (scheduled at 2022-05-05 11:04:15.685352+00:00) notificationworker stdout | 2022-05-05 11:04:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:04:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 15, 686567), True, datetime.datetime(2022, 5, 5, 11, 4, 15, 686567), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:04:15,707 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:04:15,707 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:04:15,707 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:04:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:04:16,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:46.265236+00:00 (in 29.999451 seconds) buildlogsarchiver stdout | 2022-05-05 11:04:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:04:46 UTC)" (scheduled at 2022-05-05 11:04:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:04:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 4, 16, 266364), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:04:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:04:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:04:16,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:04:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:04:22,555 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:04:22,792 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:04:22,840 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:04:22,845 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:04:22,937 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:04:22,942 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:04:22,949 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:04:22,990 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:04:23,029 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:04:23,080 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:04:23,090 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:04:23,154 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:04:23,191 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:04:23,226 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:04:23,233 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:04:23,314 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:04:23,322 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:04:23,485 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:04:23,562 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:04:24,323 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:04:24,328 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:04:24,333 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:04:24,345 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:04:24,351 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:04:24,384 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:04:24,389 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:04:24,395 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:04:24,401 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:04:24,411 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:04:24,417 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:04:24,423 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:04:24,428 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:04:24,437 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:04:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:04:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:26.930811+00:00 (in 1.958743 seconds) exportactionlogsworker stdout | 2022-05-05 11:04:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:24 UTC)" (scheduled at 2022-05-05 11:04:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:04:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:04:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:04:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:04:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:32.784864+00:00 (in 7.098924 seconds) notificationworker stdout | 2022-05-05 11:04:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:35 UTC)" (scheduled at 2022-05-05 11:04:25.685352+00:00) notificationworker stdout | 2022-05-05 11:04:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:04:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 25, 686464), True, datetime.datetime(2022, 5, 5, 11, 4, 25, 686464), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:04:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:04:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:04:25,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:04:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:04:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:24.971405+00:00 (in 58.040018 seconds) exportactionlogsworker stdout | 2022-05-05 11:04:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:26 UTC)" (scheduled at 2022-05-05 11:04:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:04:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:04:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 26, 932049), True, datetime.datetime(2022, 5, 5, 11, 4, 26, 932049), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:04:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:04:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:04:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:04:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:04:28,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:58.857216+00:00 (in 29.999461 seconds) gcworker stdout | 2022-05-05 11:04:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:04:58 UTC)" (scheduled at 2022-05-05 11:04:28.857216+00:00) gcworker stdout | 2022-05-05 11:04:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:04:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:04:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:04:30,147 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:04:30,168 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:04:30,179 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:04:30,188 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:04:30,194 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:04:30,199 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:04:30,204 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:04:30,209 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:04:30,214 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:04:30,223 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:04:30,232 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:04:30,238 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:04:30,244 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:04:30,249 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:04:30,255 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:04:30,260 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:04:30,267 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:04:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:04:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:35.685352+00:00 (in 2.899954 seconds) notificationworker stdout | 2022-05-05 11:04:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:32 UTC)" (scheduled at 2022-05-05 11:04:32.784864+00:00) notificationworker stdout | 2022-05-05 11:04:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:04:32,785 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:04:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:04:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:38.705240+00:00 (in 5.910280 seconds) namespacegcworker stdout | 2022-05-05 11:04:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:32 UTC)" (scheduled at 2022-05-05 11:04:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:04:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:04:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:04:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:04:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:45.685352+00:00 (in 9.999309 seconds) notificationworker stdout | 2022-05-05 11:04:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:45 UTC)" (scheduled at 2022-05-05 11:04:35.685352+00:00) notificationworker stdout | 2022-05-05 11:04:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:04:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 35, 686459), True, datetime.datetime(2022, 5, 5, 11, 4, 35, 686459), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:04:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:04:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:04:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:04:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:04:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:32.794430+00:00 (in 54.088613 seconds) namespacegcworker stdout | 2022-05-05 11:04:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:38 UTC)" (scheduled at 2022-05-05 11:04:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:04:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:04:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 38, 706444), True, datetime.datetime(2022, 5, 5, 11, 4, 38, 706444), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:04:38,718 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:04:38,718 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:04:38,719 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:04:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:04:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:55.685352+00:00 (in 9.999473 seconds) notificationworker stdout | 2022-05-05 11:04:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:55 UTC)" (scheduled at 2022-05-05 11:04:45.685352+00:00) notificationworker stdout | 2022-05-05 11:04:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:04:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 45, 686480), True, datetime.datetime(2022, 5, 5, 11, 4, 45, 686480), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:04:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:04:45,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:04:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:04:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:04:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:04:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:16.265236+00:00 (in 29.999326 seconds) buildlogsarchiver stdout | 2022-05-05 11:04:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:05:16 UTC)" (scheduled at 2022-05-05 11:04:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:04:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 4, 46, 266711), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:04:46,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:04:46,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:04:46,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:05:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:04:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:04:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:04:51.436849+00:00 (in 1.912259 seconds) repositorygcworker stdout | 2022-05-05 11:04:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:49 UTC)" (scheduled at 2022-05-05 11:04:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:04:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:04:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:04:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:04:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:49.523944+00:00 (in 58.086415 seconds) repositorygcworker stdout | 2022-05-05 11:04:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:51 UTC)" (scheduled at 2022-05-05 11:04:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:04:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:04:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 51, 438120), True, datetime.datetime(2022, 5, 5, 11, 4, 51, 438120), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:04:51,451 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:04:51,451 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:04:51,452 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:05:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:04:52,570 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:04:52,829 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:04:52,880 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:04:52,886 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositorygcworker stdout | 2022-05-05 11:04:52,979 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:04:52,986 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:04:52,991 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:04:53,030 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:04:53,067 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:04:53,120 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:04:53,127 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:04:53,180 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:04:53,214 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:04:53,267 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:04:53,276 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:04:53,339 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:04:53,361 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:04:53,527 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:04:53,602 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:04:54,333 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:04:54,340 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:04:54,345 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:04:54,354 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:04:54,359 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:04:54,398 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:04:54,404 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:04:54,411 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:04:54,420 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:04:54,426 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:04:54,431 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:04:54,440 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:04:54,446 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:04:54,451 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:04:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:04:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:05.685352+00:00 (in 9.999376 seconds) notificationworker stdout | 2022-05-05 11:04:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:05 UTC)" (scheduled at 2022-05-05 11:04:55.685352+00:00) notificationworker stdout | 2022-05-05 11:04:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:04:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 4, 55, 686503), True, datetime.datetime(2022, 5, 5, 11, 4, 55, 686503), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:04:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:04:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:04:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:04:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:04:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:28.857216+00:00 (in 29.999301 seconds) gcworker stdout | 2022-05-05 11:04:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:05:28 UTC)" (scheduled at 2022-05-05 11:04:58.857216+00:00) gcworker stdout | 2022-05-05 11:04:58,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:04:58,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:05:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:05:00,161 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:05:00,182 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:05:00,191 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:05:00,208 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:05:00,214 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:05:00,219 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:05:00,224 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:05:00,231 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:05:00,236 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:05:00,243 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:05:00,250 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:05:00,255 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:05:00,263 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:05:00,269 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:05:00,274 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:05:00,280 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:05:00,284 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:05:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:05:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:15.685352+00:00 (in 9.999458 seconds) notificationworker stdout | 2022-05-05 11:05:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:15 UTC)" (scheduled at 2022-05-05 11:05:05.685352+00:00) notificationworker stdout | 2022-05-05 11:05:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:05:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 5, 686478), True, datetime.datetime(2022, 5, 5, 11, 5, 5, 686478), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:05:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:05:05,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:05:05,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:15 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:05:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:05:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:25.685352+00:00 (in 9.999362 seconds) notificationworker stdout | 2022-05-05 11:05:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:25 UTC)" (scheduled at 2022-05-05 11:05:15.685352+00:00) notificationworker stdout | 2022-05-05 11:05:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:05:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 15, 686683), True, datetime.datetime(2022, 5, 5, 11, 5, 15, 686683), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:05:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:05:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:05:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:05:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:05:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:46.265236+00:00 (in 29.999142 seconds) buildlogsarchiver stdout | 2022-05-05 11:05:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:05:46 UTC)" (scheduled at 2022-05-05 11:05:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:05:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 5, 16, 266716), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:05:16,280 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:05:16,280 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:05:16,280 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:05:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:05:22,611 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:05:22,870 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:05:22,923 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:05:22,928 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositoryactioncounter stdout | 2022-05-05 11:05:23,009 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:05:23,014 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:05:23,025 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} notificationworker stdout | 2022-05-05 11:05:23,070 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:05:23,108 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:05:23,156 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:05:23,164 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:05:23,218 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:05:23,254 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:05:23,311 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:05:23,317 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:05:23,350 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:05:23,401 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:05:23,561 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:05:23,642 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:05:24,345 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:05:24,354 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:05:24,360 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:05:24,365 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:05:24,370 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:05:24,412 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:05:24,419 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:05:24,427 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:05:24,435 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:05:24,441 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:05:24,450 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:05:24,455 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:05:24,462 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:05:24,467 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:05:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:05:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:26.930811+00:00 (in 1.958620 seconds) exportactionlogsworker stdout | 2022-05-05 11:05:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:24 UTC)" (scheduled at 2022-05-05 11:05:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:05:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:05:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:05:25,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:05:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:31.783119+00:00 (in 6.096948 seconds) notificationworker stdout | 2022-05-05 11:05:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:35 UTC)" (scheduled at 2022-05-05 11:05:25.685352+00:00) notificationworker stdout | 2022-05-05 11:05:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:05:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 25, 686772), True, datetime.datetime(2022, 5, 5, 11, 5, 25, 686772), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:05:25,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:05:25,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:05:25,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:05:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:05:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:24.970422+00:00 (in 58.038910 seconds) exportactionlogsworker stdout | 2022-05-05 11:05:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:26 UTC)" (scheduled at 2022-05-05 11:05:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:05:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:05:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 26, 932127), True, datetime.datetime(2022, 5, 5, 11, 5, 26, 932127), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:05:26,942 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:05:26,942 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:05:26,943 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:05:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:05:28,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:58.857216+00:00 (in 29.999455 seconds) gcworker stdout | 2022-05-05 11:05:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:05:58 UTC)" (scheduled at 2022-05-05 11:05:28.857216+00:00) gcworker stdout | 2022-05-05 11:05:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:05:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:05:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:05:30,177 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:05:30,194 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:05:30,204 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:05:30,222 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:05:30,228 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:05:30,233 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:05:30,239 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:05:30,246 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:05:30,252 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:05:30,260 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:05:30,266 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:05:30,271 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:05:30,278 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:05:30,284 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:05:30,292 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:05:30,298 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:05:30,307 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:05:31,783 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:05:31,783 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:32.784864+00:00 (in 1.001147 seconds) notificationworker stdout | 2022-05-05 11:05:31,784 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:10:31 UTC)" (scheduled at 2022-05-05 11:05:31.783119+00:00) notificationworker stdout | 2022-05-05 11:05:31,784 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 5, 31, 784288), 'notification/%']) notificationworker stdout | 2022-05-05 11:05:31,794 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 5, 31, 784288), True, datetime.datetime(2022, 5, 5, 11, 5, 31, 784288), 0, 'notification/%']) notificationworker stdout | 2022-05-05 11:05:31,796 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 5, 31, 784288), True, datetime.datetime(2022, 5, 5, 11, 5, 31, 784288), 0, 'notification/%', False, datetime.datetime(2022, 5, 5, 11, 5, 31, 784288), 'notification/%']) notificationworker stdout | 2022-05-05 11:05:31,797 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:05:31,798 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:10:31 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:05:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:05:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:35.685352+00:00 (in 2.899862 seconds) notificationworker stdout | 2022-05-05 11:05:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:32 UTC)" (scheduled at 2022-05-05 11:05:32.784864+00:00) notificationworker stdout | 2022-05-05 11:05:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:05:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:05:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:05:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:38.705240+00:00 (in 5.910198 seconds) namespacegcworker stdout | 2022-05-05 11:05:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:32 UTC)" (scheduled at 2022-05-05 11:05:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:05:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:05:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:05:35,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:05:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:45.685352+00:00 (in 9.998620 seconds) notificationworker stdout | 2022-05-05 11:05:35,687 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:45 UTC)" (scheduled at 2022-05-05 11:05:35.685352+00:00) notificationworker stdout | 2022-05-05 11:05:35,687 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:05:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 35, 687342), True, datetime.datetime(2022, 5, 5, 11, 5, 35, 687342), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:05:35,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:05:35,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:05:35,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:05:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:05:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:32.794430+00:00 (in 54.088683 seconds) namespacegcworker stdout | 2022-05-05 11:05:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:38 UTC)" (scheduled at 2022-05-05 11:05:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:05:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:05:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 38, 706163), True, datetime.datetime(2022, 5, 5, 11, 5, 38, 706163), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:05:38,721 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:05:38,722 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:05:38,722 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:05:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:05:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:55.685352+00:00 (in 9.999439 seconds) notificationworker stdout | 2022-05-05 11:05:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:55 UTC)" (scheduled at 2022-05-05 11:05:45.685352+00:00) notificationworker stdout | 2022-05-05 11:05:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:05:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 45, 686511), True, datetime.datetime(2022, 5, 5, 11, 5, 45, 686511), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:05:45,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:05:45,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:05:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:05:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:05:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:05:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:16.265236+00:00 (in 29.999209 seconds) buildlogsarchiver stdout | 2022-05-05 11:05:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:06:16 UTC)" (scheduled at 2022-05-05 11:05:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:05:46,268 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 5, 46, 266615), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:05:46,281 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:05:46,281 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:05:46,281 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:06:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:05:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:05:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:05:51.436849+00:00 (in 1.912283 seconds) repositorygcworker stdout | 2022-05-05 11:05:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:49 UTC)" (scheduled at 2022-05-05 11:05:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:05:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:05:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:05:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:05:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:49.523944+00:00 (in 58.086543 seconds) repositorygcworker stdout | 2022-05-05 11:05:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:51 UTC)" (scheduled at 2022-05-05 11:05:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:05:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:05:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 51, 437960), True, datetime.datetime(2022, 5, 5, 11, 5, 51, 437960), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:05:51,451 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:05:51,451 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:05:51,451 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:05:52,649 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:05:52,909 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:05:52,964 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:05:52,970 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} repositoryactioncounter stdout | 2022-05-05 11:05:53,048 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:05:53,057 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:05:53,064 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} notificationworker stdout | 2022-05-05 11:05:53,090 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:05:53,148 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:05:53,182 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:05:53,201 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:05:53,238 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:05:53,283 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:05:53,350 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:05:53,362 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:05:53,390 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:05:53,438 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:05:53,575 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:05:53,658 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:05:54,360 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:05:54,365 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:05:54,371 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:05:54,377 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:05:54,382 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:05:54,423 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:05:54,428 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:05:54,438 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:05:54,445 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:05:54,451 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:05:54,459 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:05:54,465 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:05:54,472 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:05:54,478 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:05:55,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:05:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:05.685352+00:00 (in 9.998835 seconds) notificationworker stdout | 2022-05-05 11:05:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:05 UTC)" (scheduled at 2022-05-05 11:05:55.685352+00:00) notificationworker stdout | 2022-05-05 11:05:55,687 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:05:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 5, 55, 687076), True, datetime.datetime(2022, 5, 5, 11, 5, 55, 687076), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:05:55,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:05:55,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:05:55,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:05:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:05:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:28.857216+00:00 (in 29.999376 seconds) gcworker stdout | 2022-05-05 11:05:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:06:28 UTC)" (scheduled at 2022-05-05 11:05:58.857216+00:00) gcworker stdout | 2022-05-05 11:05:58,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:05:58,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:06:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:06:00,193 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:06:00,208 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:06:00,215 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:06:00,234 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:06:00,239 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:06:00,245 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:06:00,250 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:06:00,258 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:06:00,265 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:06:00,273 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:06:00,278 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:06:00,284 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:06:00,289 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:06:00,298 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:06:00,308 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:06:00,314 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:06:00,320 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:06:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:06:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:15.685352+00:00 (in 9.999344 seconds) notificationworker stdout | 2022-05-05 11:06:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:15 UTC)" (scheduled at 2022-05-05 11:06:05.685352+00:00) notificationworker stdout | 2022-05-05 11:06:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:06:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 5, 686536), True, datetime.datetime(2022, 5, 5, 11, 6, 5, 686536), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:06:05,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:06:05,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:06:05,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:15 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:06:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:06:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:25.685352+00:00 (in 9.999435 seconds) notificationworker stdout | 2022-05-05 11:06:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:25 UTC)" (scheduled at 2022-05-05 11:06:15.685352+00:00) notificationworker stdout | 2022-05-05 11:06:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:06:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 15, 686515), True, datetime.datetime(2022, 5, 5, 11, 6, 15, 686515), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:06:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:06:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:06:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:06:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:06:16,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:46.265236+00:00 (in 29.999421 seconds) buildlogsarchiver stdout | 2022-05-05 11:06:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:06:46 UTC)" (scheduled at 2022-05-05 11:06:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:06:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 6, 16, 266418), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:06:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:06:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:06:16,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:06:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:06:22,683 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:06:22,950 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:06:22,998 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:06:23,009 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:06:23,079 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:06:23,085 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:06:23,092 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:06:23,128 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:06:23,167 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:06:23,222 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:06:23,230 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:06:23,278 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:06:23,327 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:06:23,385 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:06:23,395 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:06:23,421 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:06:23,470 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:06:23,610 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:06:23,679 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:06:24,373 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:06:24,381 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:06:24,388 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:06:24,392 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:06:24,398 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:06:24,437 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:06:24,444 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:06:24,450 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:06:24,457 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:06:24,463 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:06:24,472 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:06:24,477 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:06:24,486 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:06:24,491 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:06:24,970 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:06:24,971 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:24.971405+00:00 (in 0.000404 seconds) exportactionlogsworker stdout | 2022-05-05 11:06:24,971 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:11:24 UTC)" (scheduled at 2022-05-05 11:06:24.970422+00:00) exportactionlogsworker stdout | 2022-05-05 11:06:24,972 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 6, 24, 971572), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:06:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:06:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:06:24 UTC)" (scheduled at 2022-05-05 11:06:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:06:24,973 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:26.930811+00:00 (in 1.958274 seconds) exportactionlogsworker stdout | 2022-05-05 11:06:24,973 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:06:24,973 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:24 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:06:24,983 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 6, 24, 971572), True, datetime.datetime(2022, 5, 5, 11, 6, 24, 971572), 0, 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:06:24,985 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 6, 24, 971572), True, datetime.datetime(2022, 5, 5, 11, 6, 24, 971572), 0, 'exportactionlogs/%', False, datetime.datetime(2022, 5, 5, 11, 6, 24, 971572), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:06:24,987 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:06:24,987 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:11:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:06:25,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:06:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:32.784864+00:00 (in 7.098677 seconds) notificationworker stdout | 2022-05-05 11:06:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:35 UTC)" (scheduled at 2022-05-05 11:06:25.685352+00:00) notificationworker stdout | 2022-05-05 11:06:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:06:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 25, 686781), True, datetime.datetime(2022, 5, 5, 11, 6, 25, 686781), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:06:25,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:06:25,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:06:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:06:26,932 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:06:26,932 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:24.971405+00:00 (in 58.039206 seconds) exportactionlogsworker stdout | 2022-05-05 11:06:26,932 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:26 UTC)" (scheduled at 2022-05-05 11:06:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:06:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:06:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 26, 932864), True, datetime.datetime(2022, 5, 5, 11, 6, 26, 932864), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:06:26,945 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:06:26,945 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:06:26,946 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:06:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:06:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:58.857216+00:00 (in 29.999376 seconds) gcworker stdout | 2022-05-05 11:06:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:06:58 UTC)" (scheduled at 2022-05-05 11:06:28.857216+00:00) gcworker stdout | 2022-05-05 11:06:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:06:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:06:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:06:30,206 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:06:30,220 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:06:30,227 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:06:30,251 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:06:30,258 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:06:30,264 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:06:30,270 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:06:30,275 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:06:30,282 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:06:30,287 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:06:30,295 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:06:30,306 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:06:30,311 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:06:30,316 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:06:30,324 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:06:30,329 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:06:30,335 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:06:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:06:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:35.685352+00:00 (in 2.899798 seconds) notificationworker stdout | 2022-05-05 11:06:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:32 UTC)" (scheduled at 2022-05-05 11:06:32.784864+00:00) notificationworker stdout | 2022-05-05 11:06:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:06:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:06:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:06:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:38.705240+00:00 (in 5.910280 seconds) namespacegcworker stdout | 2022-05-05 11:06:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:32 UTC)" (scheduled at 2022-05-05 11:06:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:06:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:06:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:06:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:06:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:45.685352+00:00 (in 9.999183 seconds) notificationworker stdout | 2022-05-05 11:06:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:45 UTC)" (scheduled at 2022-05-05 11:06:35.685352+00:00) notificationworker stdout | 2022-05-05 11:06:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:06:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 35, 686900), True, datetime.datetime(2022, 5, 5, 11, 6, 35, 686900), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:06:35,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:06:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:06:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:06:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:06:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:32.794430+00:00 (in 54.088608 seconds) namespacegcworker stdout | 2022-05-05 11:06:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:38 UTC)" (scheduled at 2022-05-05 11:06:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:06:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:06:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 38, 706412), True, datetime.datetime(2022, 5, 5, 11, 6, 38, 706412), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:06:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:06:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:06:38,718 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:06:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:06:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:55.685352+00:00 (in 9.999285 seconds) notificationworker stdout | 2022-05-05 11:06:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:55 UTC)" (scheduled at 2022-05-05 11:06:45.685352+00:00) notificationworker stdout | 2022-05-05 11:06:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:06:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 45, 686682), True, datetime.datetime(2022, 5, 5, 11, 6, 45, 686682), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:06:45,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:06:45,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:06:45,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:06:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:06:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:06:46,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:16.265236+00:00 (in 29.999445 seconds) buildlogsarchiver stdout | 2022-05-05 11:06:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:07:16 UTC)" (scheduled at 2022-05-05 11:06:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:06:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 6, 46, 266261), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:06:46,280 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:06:46,280 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:06:46,280 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:07:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:06:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:06:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:06:51.436849+00:00 (in 1.912250 seconds) repositorygcworker stdout | 2022-05-05 11:06:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:49 UTC)" (scheduled at 2022-05-05 11:06:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:06:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:06:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:06:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:06:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:49.523944+00:00 (in 58.086478 seconds) repositorygcworker stdout | 2022-05-05 11:06:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:51 UTC)" (scheduled at 2022-05-05 11:06:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:06:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:06:51,438 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 51, 438022), True, datetime.datetime(2022, 5, 5, 11, 6, 51, 438022), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:06:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:06:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:06:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:07:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:06:52,717 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:06:52,988 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:06:53,040 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:06:53,045 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} repositorygcworker stdout | 2022-05-05 11:06:53,117 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:06:53,122 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:06:53,127 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:06:53,165 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:06:53,205 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} queuecleanupworker stdout | 2022-05-05 11:06:53,259 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} securityscanningnotificationworker stdout | 2022-05-05 11:06:53,268 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:06:53,316 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:06:53,368 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:06:53,426 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:06:53,439 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:06:53,457 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:06:53,486 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:06:53,650 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:06:53,717 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:06:54,384 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:06:54,392 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:06:54,398 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:06:54,404 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:06:54,417 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:06:54,458 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:06:54,466 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:06:54,480 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:06:54,485 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:06:54,490 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:06:54,498 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:06:54,505 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:06:54,512 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:06:54,517 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:06:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:06:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:05.685352+00:00 (in 9.999431 seconds) notificationworker stdout | 2022-05-05 11:06:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:05 UTC)" (scheduled at 2022-05-05 11:06:55.685352+00:00) notificationworker stdout | 2022-05-05 11:06:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:06:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 6, 55, 686525), True, datetime.datetime(2022, 5, 5, 11, 6, 55, 686525), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:06:55,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:06:55,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:06:55,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:06:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:06:58,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:28.857216+00:00 (in 29.999458 seconds) gcworker stdout | 2022-05-05 11:06:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:07:28 UTC)" (scheduled at 2022-05-05 11:06:58.857216+00:00) gcworker stdout | 2022-05-05 11:06:58,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:06:58,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:07:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:07:00,220 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:07:00,232 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:07:00,263 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:07:00,270 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:07:00,277 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:07:00,284 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:07:00,292 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:07:00,299 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:07:00,304 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:07:00,309 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:07:00,317 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:07:00,326 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:07:00,337 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:07:00,339 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:07:00,342 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:07:00,348 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:07:00,937 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:07:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:07:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:15.685352+00:00 (in 9.999310 seconds) notificationworker stdout | 2022-05-05 11:07:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:15 UTC)" (scheduled at 2022-05-05 11:07:05.685352+00:00) notificationworker stdout | 2022-05-05 11:07:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:07:05,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 5, 686771), True, datetime.datetime(2022, 5, 5, 11, 7, 5, 686771), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:07:05,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:07:05,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:07:05,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:07:08,466 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b?blockid=REDACTED&comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:08,466 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:07:08,466 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:07:08,466 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:07:08,466 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '964328669' gunicorn-registry stdout | 2022-05-05 11:07:08,466 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:08,467 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:08,467 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '80251c84-cc63-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:08,467 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:07:08,467 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:08,467 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:08,467 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:07:08,470 [245] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): quaystorageaccount2.blob.core.windows.net:443 notificationworker stdout | 2022-05-05 11:07:15,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:07:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:25.685352+00:00 (in 9.999078 seconds) notificationworker stdout | 2022-05-05 11:07:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:25 UTC)" (scheduled at 2022-05-05 11:07:15.685352+00:00) notificationworker stdout | 2022-05-05 11:07:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:07:15,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 15, 686811), True, datetime.datetime(2022, 5, 5, 11, 7, 15, 686811), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:07:15,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:07:15,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:07:15,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:07:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:07:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:46.265236+00:00 (in 29.999333 seconds) buildlogsarchiver stdout | 2022-05-05 11:07:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:07:46 UTC)" (scheduled at 2022-05-05 11:07:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:07:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 7, 16, 266494), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:07:16,287 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:07:16,288 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:07:16,288 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:07:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:07:22,745 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} gunicorn-registry stdout | 2022-05-05 11:07:22,917 [245] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b?blockid=MDAwMDA%3D&comp=block HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:07:22,918 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '0503b130-d01e-0015-4070-600025000000' gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '80251c84-cc63-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:22,919 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:07:22 GMT' gunicorn-registry stdout | 2022-05-05 11:07:22,924 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['00fa8baa-98e9-47b5-9993-723f35e1928b', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:22,926 [245] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '00fa8baa-98e9-47b5-9993-723f35e1928b', 964328669, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3gBrWPsag2fxMLZFR5dRcP9ZTwH1G91hTtEIvHA7gaVdOjm08sBAAAAJ8TP8Sb2398XX3zx5U+W/x0AAP//96q8PwDO15UAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAB0AAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 1, 2513948160, datetime.datetime(2022, 5, 5, 11, 3, 34, 741681), None, None, 3]) gunicorn-registry stdout | 2022-05-05 11:07:22,930 [245] [DEBUG] [app] Ending request: urn:request:327e9f82-a918-40fe-8e81-5af3dd285ab4 (/v2/ibazulic/test-big-layers/blobs/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b) gunicorn-registry stdout | 2022-05-05 11:07:22,930 [245] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:07:22,931 [245] [DEBUG] [peewee.pool] Returning 140025700772288 to pool. gunicorn-registry stdout | 2022-05-05 11:07:22,931 [245] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:07:22 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:07:22 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (228.121 964565491 228.087) gunicorn-registry stdout | 2022-05-05 11:07:22,997 [231] [DEBUG] [app] Starting request: urn:request:0db79139-5501-4d0b-b9f2-856356da5830 (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:07:22,997 [231] [DEBUG] [auth.basic] Attempt to process basic auth header gunicorn-registry stdout | 2022-05-05 11:07:22,999 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['ibazulic', 'ibazulic', 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:07:23,028 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:07:23,075 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:07:23,082 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositoryactioncounter stdout | 2022-05-05 11:07:23,145 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:07:23,152 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:07:23,161 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} notificationworker stdout | 2022-05-05 11:07:23,208 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:07:23,241 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} queuecleanupworker stdout | 2022-05-05 11:07:23,293 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} securityscanningnotificationworker stdout | 2022-05-05 11:07:23,304 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} gunicorn-registry stdout | 2022-05-05 11:07:23,335 [231] [DEBUG] [auth.credentials] Successfully validated credentials for user ibazulic gunicorn-registry stdout | 2022-05-05 11:07:23,335 [231] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-registry stdout | 2022-05-05 11:07:23,335 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:07:23,335 [231] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:07:23,335 [231] [DEBUG] [endpoints.v2.v2auth] Request audience: 20.67.27.216 gunicorn-registry stdout | 2022-05-05 11:07:23,335 [231] [DEBUG] [endpoints.v2.v2auth] Scope request: ['repository:ibazulic/test-big-layers:push,pull'] gunicorn-registry stdout | 2022-05-05 11:07:23,336 [231] [DEBUG] [endpoints.v2.v2auth] Match: ('ibazulic/test-big-layers', 'ibazulic/test-big-layers', 'push,pull') gunicorn-registry stdout | 2022-05-05 11:07:23,338 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:23,341 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:23,343 [231] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:07:23,344 [231] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:07:23,344 [231] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:07:23,344 [231] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:07:23,344 [231] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-registry stdout | 2022-05-05 11:07:23,344 [231] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd namespacegcworker stdout | 2022-05-05 11:07:23,351 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} gunicorn-registry stdout | 2022-05-05 11:07:23,353 [231] [DEBUG] [app] Ending request: urn:request:0db79139-5501-4d0b-b9f2-856356da5830 (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:07:23,353 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:07:23,353 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:07:23,353 [231] [INFO] [gunicorn.access] 93.136.90.201 - ibazulic [05/May/2022:11:07:23 +0000] "GET /v2/auth?account=ibazulic&scope=repository%3Aibazulic%2Ftest-big-layers%3Apush%2Cpull&service=20.67.27.216 HTTP/1.1" 200 1033 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - ibazulic [05/May/2022:11:07:23 +0000] "GET /v2/auth?account=ibazulic&scope=repository%3Aibazulic%2Ftest-big-layers%3Apush%2Cpull&service=20.67.27.216 HTTP/1.1" 200 1033 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.357 385 0.356) gunicorn-registry stdout | 2022-05-05 11:07:23,354 [231] [DEBUG] [data.userevent] Published user event docker-cli: {'action': 'push_start', 'namespace': 'ibazulic', 'repository': 'test-big-layers'} expiredappspecifictokenworker stdout | 2022-05-05 11:07:23,408 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} gunicorn-registry stdout | 2022-05-05 11:07:23,427 [231] [DEBUG] [app] Starting request: urn:request:46897321-a1c6-46c3-b681-64e9107cb8e6 (/v2/ibazulic/test-big-layers/blobs/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b) gunicorn-registry stdout | 2022-05-05 11:07:23,427 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '00fa8baa-98e9-47b5-9993-723f35e1928b', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:07:23,427 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4ODQzLCJpYXQiOjE2NTE3NDg4NDMsImV4cCI6MTY1MTc1MjQ0Mywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.FOdPHLN8DEh3cteCbZlFaYgnUQqEJGioYApOEo2xFvS7WPziF6NgGHes9Vz1M4SMJvVwIorC3mI34OR9Nt3Qsqmhw6gvcF1J754sAzTc_UrAizYVgEv3txStHaxYy6xGom-CUQnT5VepMeUiAGi9EIqi1nDvbzIpIOqAFM_xNV--45yGfkgR49acF0yFuBZsSyKu7zyd2hG5zTxpGDyxxmGINh9x72wxLiBvrsZKco98g9vRBtSiZO61MbsRipuHRIEbv2Nr6QG8s-0ThwSOpNzwyALgpJWqTH9V81AXswIJ-soNPOaTNKszZSuQNLWpAbLOdvRigqZF8RRI2an_-w gunicorn-registry stdout | 2022-05-05 11:07:23,427 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4ODQzLCJpYXQiOjE2NTE3NDg4NDMsImV4cCI6MTY1MTc1MjQ0Mywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.FOdPHLN8DEh3cteCbZlFaYgnUQqEJGioYApOEo2xFvS7WPziF6NgGHes9Vz1M4SMJvVwIorC3mI34OR9Nt3Qsqmhw6gvcF1J754sAzTc_UrAizYVgEv3txStHaxYy6xGom-CUQnT5VepMeUiAGi9EIqi1nDvbzIpIOqAFM_xNV--45yGfkgR49acF0yFuBZsSyKu7zyd2hG5zTxpGDyxxmGINh9x72wxLiBvrsZKco98g9vRBtSiZO61MbsRipuHRIEbv2Nr6QG8s-0ThwSOpNzwyALgpJWqTH9V81AXswIJ-soNPOaTNKszZSuQNLWpAbLOdvRigqZF8RRI2an_-w gunicorn-registry stdout | 2022-05-05 11:07:23,429 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:07:23,430 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:07:23,430 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:07:23,430 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:07:23,430 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:07:23,431 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:23,434 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['00fa8baa-98e9-47b5-9993-723f35e1928b', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:23,436 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:07:23,436 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:07:23,437 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['00fa8baa-98e9-47b5-9993-723f35e1928b', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:23,439 [231] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '00fa8baa-98e9-47b5-9993-723f35e1928b', 964328669, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3gBrWPsag2fxMLZFR5dRcP9ZTwH1G91hTtEIvHA7gaVdOjm08sBAAAAJ8TP8Sb2398XX3zx5U+W/x0AAP//96q8PwDO15UAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAB0AAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 2, 2513948160, datetime.datetime(2022, 5, 5, 11, 3, 34, 741681), None, None, 3]) gunicorn-registry stdout | 2022-05-05 11:07:23,442 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:07:23,443 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c' gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8a389fb6-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,444 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:07:23,445 [231] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: quaystorageaccount2.blob.core.windows.net manifestbackfillworker stdout | 2022-05-05 11:07:23,449 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:07:23,456 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:07:23,494 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:07:23,526 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-registry stdout | 2022-05-05 11:07:23,646 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 404 0 gunicorn-registry stdout | 2022-05-05 11:07:23,646 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 404 gunicorn-registry stdout | 2022-05-05 11:07:23,646 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:07:23,646 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Transfer-Encoding': 'chunked' gunicorn-registry stdout | 2022-05-05 11:07:23,647 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:07:23,647 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '7dfd5af3-d01e-003a-2670-600dee000000' gunicorn-registry stdout | 2022-05-05 11:07:23,647 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8a389fb6-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:23,647 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,647 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-error-code': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,647 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:07:22 GMT' gunicorn-registry stdout | 2022-05-05 11:07:23,648 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b?comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,648 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:07:23,648 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/xml; charset=utf-8' gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-content-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '87' gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8a57dd9a-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,649 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:07:23,659 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b?comp=blocklist HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:07:23 GMT' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E876E8DB6B4"' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '7dfd5af8-d01e-003a-2970-600dee000000' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8a57dd9a-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-content-crc64': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,660 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:07:22 GMT' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8a59e644-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:23,662 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request servicekey stdout | 2022-05-05 11:07:23,689 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:07:23,759 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:07:24,396 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:07:24,401 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:07:24,408 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:07:24,414 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:07:24,427 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:07:24,470 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:07:24,476 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:07:24,491 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:07:24,496 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:07:24,501 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:07:24,518 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:07:24,520 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:07:24,525 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:07:24,531 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:07:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:07:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:26.930811+00:00 (in 1.958596 seconds) exportactionlogsworker stdout | 2022-05-05 11:07:24,973 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:24 UTC)" (scheduled at 2022-05-05 11:07:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:07:24,973 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:07:24,973 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:07:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:07:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:32.784864+00:00 (in 7.098862 seconds) notificationworker stdout | 2022-05-05 11:07:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:35 UTC)" (scheduled at 2022-05-05 11:07:25.685352+00:00) notificationworker stdout | 2022-05-05 11:07:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:07:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 25, 686443), True, datetime.datetime(2022, 5, 5, 11, 7, 25, 686443), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:07:25,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:07:25,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:07:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:07:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:07:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:24.971405+00:00 (in 58.039828 seconds) exportactionlogsworker stdout | 2022-05-05 11:07:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:26 UTC)" (scheduled at 2022-05-05 11:07:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:07:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:07:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 26, 932107), True, datetime.datetime(2022, 5, 5, 11, 7, 26, 932107), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:07:26,942 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:07:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:07:26,943 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:26 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:07:27,986 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:07:27 GMT' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E877121BE6E"' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '7dfd5afc-d01e-003a-2d70-600dee000000' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8a59e644-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,987 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:07:27 GMT' gunicorn-registry stdout | 2022-05-05 11:07:27,988 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c' gunicorn-registry stdout | 2022-05-05 11:07:27,988 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:07:27,988 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:07:27,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8cee1ace-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:27,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:07:27,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,989 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:07:27,994 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 200 0 gunicorn-registry stdout | 2022-05-05 11:07:27,994 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 200 gunicorn-registry stdout | 2022-05-05 11:07:27,994 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:07:27,994 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '964328669' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:07:27 GMT' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Accept-Ranges': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E877121BE6E"' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '7dfd61ec-d01e-003a-6c70-600dee000000' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8cee1ace-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-creation-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-state': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-progress': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-completion-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier-inferred': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,995 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:07:27 GMT' gunicorn-registry stdout | 2022-05-05 11:07:27,996 [231] [DEBUG] [storage.azurestorage] Deleting chunked upload 00fa8baa-98e9-47b5-9993-723f35e1928b at path registry/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b gunicorn-registry stdout | 2022-05-05 11:07:27,997 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b' gunicorn-registry stdout | 2022-05-05 11:07:27,997 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'DELETE' gunicorn-registry stdout | 2022-05-05 11:07:27,997 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:07:27,997 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,997 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,998 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8cef781a-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:27,998 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:07:27,998 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:27,998 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "DELETE /quayblobstorage/registry/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '7dfd61f3-d01e-003a-7270-600dee000000' gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8cef781a-cc63-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-delete-type-permanent': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:07:28,005 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:07:27 GMT' gunicorn-registry stdout | 2022-05-05 11:07:28,007 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['00fa8baa-98e9-47b5-9993-723f35e1928b', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:28,008 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."image_size", "t1"."uncompressed_size", "t1"."uploading", "t1"."cas_path", "t1"."content_checksum" FROM "imagestorage" AS "t1" WHERE ("t1"."content_checksum" = %s) LIMIT %s OFFSET %s', ['sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:28,009 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorage" ("uuid", "image_size", "uncompressed_size", "uploading", "cas_path", "content_checksum") VALUES (%s, %s, %s, %s, %s, %s) RETURNING "imagestorage"."id"', ['6ce1669f-c5d6-44bc-97fb-ded4e75b695d', 964328669, 2513948160, True, True, 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c']) gunicorn-registry stdout | 2022-05-05 11:07:28,010 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorageplacement" ("storage_id", "location_id") VALUES (%s, %s) RETURNING "imagestorageplacement"."id"', [4, 9]) gunicorn-registry stdout | 2022-05-05 11:07:28,011 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:28,012 [231] [DEBUG] [peewee] ('INSERT INTO "uploadedblob" ("repository_id", "blob_id", "uploaded_at", "expires_at") VALUES (%s, %s, %s, %s) RETURNING "uploadedblob"."id"', [1, 4, datetime.datetime(2022, 5, 5, 11, 7, 28, 12313), datetime.datetime(2022, 5, 5, 12, 7, 28, 12301)]) gunicorn-registry stdout | 2022-05-05 11:07:28,013 [231] [DEBUG] [peewee] ('DELETE FROM "blobupload" WHERE ("blobupload"."id" = %s)', [3]) gunicorn-registry stdout | 2022-05-05 11:07:28,038 [231] [DEBUG] [app] Ending request: urn:request:46897321-a1c6-46c3-b681-64e9107cb8e6 (/v2/ibazulic/test-big-layers/blobs/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b) gunicorn-registry stdout | 2022-05-05 11:07:28,039 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:07:28,039 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. nginx stdout | 93.136.90.201 () - - [05/May/2022:11:07:28 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b?digest=sha256%3A273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (4.613 1455 4.612) gunicorn-registry stdout | 2022-05-05 11:07:28,039 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:07:28 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/00fa8baa-98e9-47b5-9993-723f35e1928b?digest=sha256%3A273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:07:28,110 [231] [DEBUG] [app] Starting request: urn:request:a4f176a9-d652-4578-91f5-3b8759f583a5 (/v2/ibazulic/test-big-layers/blobs/sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c) gunicorn-registry stdout | 2022-05-05 11:07:28,111 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:07:28,111 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4ODQzLCJpYXQiOjE2NTE3NDg4NDMsImV4cCI6MTY1MTc1MjQ0Mywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.FOdPHLN8DEh3cteCbZlFaYgnUQqEJGioYApOEo2xFvS7WPziF6NgGHes9Vz1M4SMJvVwIorC3mI34OR9Nt3Qsqmhw6gvcF1J754sAzTc_UrAizYVgEv3txStHaxYy6xGom-CUQnT5VepMeUiAGi9EIqi1nDvbzIpIOqAFM_xNV--45yGfkgR49acF0yFuBZsSyKu7zyd2hG5zTxpGDyxxmGINh9x72wxLiBvrsZKco98g9vRBtSiZO61MbsRipuHRIEbv2Nr6QG8s-0ThwSOpNzwyALgpJWqTH9V81AXswIJ-soNPOaTNKszZSuQNLWpAbLOdvRigqZF8RRI2an_-w gunicorn-registry stdout | 2022-05-05 11:07:28,111 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ4ODQzLCJpYXQiOjE2NTE3NDg4NDMsImV4cCI6MTY1MTc1MjQ0Mywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.FOdPHLN8DEh3cteCbZlFaYgnUQqEJGioYApOEo2xFvS7WPziF6NgGHes9Vz1M4SMJvVwIorC3mI34OR9Nt3Qsqmhw6gvcF1J754sAzTc_UrAizYVgEv3txStHaxYy6xGom-CUQnT5VepMeUiAGi9EIqi1nDvbzIpIOqAFM_xNV--45yGfkgR49acF0yFuBZsSyKu7zyd2hG5zTxpGDyxxmGINh9x72wxLiBvrsZKco98g9vRBtSiZO61MbsRipuHRIEbv2Nr6QG8s-0ThwSOpNzwyALgpJWqTH9V81AXswIJ-soNPOaTNKszZSuQNLWpAbLOdvRigqZF8RRI2an_-w gunicorn-registry stdout | 2022-05-05 11:07:28,113 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:07:28,113 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:07:28,113 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:07:28,113 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:07:28,113 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:07:28,113 [231] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2 gunicorn-registry stdout | 2022-05-05 11:07:28,114 [231] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2; calling loader gunicorn-registry stdout | 2022-05-05 11:07:28,116 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:28,118 [231] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:07:28,120 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id", "t2"."id", "t2"."uuid", "t2"."image_size", "t2"."uncompressed_size", "t2"."uploading", "t2"."cas_path", "t2"."content_checksum" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['6ce1669f-c5d6-44bc-97fb-ded4e75b695d']) gunicorn-registry stdout | 2022-05-05 11:07:28,121 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['6ce1669f-c5d6-44bc-97fb-ded4e75b695d']) gunicorn-registry stdout | 2022-05-05 11:07:28,122 [231] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2: {'uuid': '6ce1669f-c5d6-44bc-97fb-ded4e75b695d', 'digest': 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 'compressed_size': 964328669, 'uncompressed_size': 2513948160, 'uploading': True, 'db_id': 4, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c'}} gunicorn-registry stdout | 2022-05-05 11:07:28,122 [231] [DEBUG] [data.cache.impl] Caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2 with expiration {'uuid': '6ce1669f-c5d6-44bc-97fb-ded4e75b695d', 'digest': 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 'compressed_size': 964328669, 'uncompressed_size': 2513948160, 'uploading': True, 'db_id': 4, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c'}}: 60s gunicorn-registry stdout | 2022-05-05 11:07:28,123 [231] [DEBUG] [data.cache.impl] Cached loaded result for key repo_blob__ibazulic_test-big-layers_sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c_2 with expiration {'uuid': '6ce1669f-c5d6-44bc-97fb-ded4e75b695d', 'digest': 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 'compressed_size': 964328669, 'uncompressed_size': 2513948160, 'uploading': True, 'db_id': 4, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/27/273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c'}}: 60s gunicorn-registry stdout | 2022-05-05 11:07:28,123 [231] [DEBUG] [app] Ending request: urn:request:a4f176a9-d652-4578-91f5-3b8759f583a5 (/v2/ibazulic/test-big-layers/blobs/sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c) gunicorn-registry stdout | 2022-05-05 11:07:28,124 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:07:28,124 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:07:28,124 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:07:28 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:07:28 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.015 1360 0.016) gcworker stdout | 2022-05-05 11:07:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:07:28,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:58.857216+00:00 (in 29.999419 seconds) gcworker stdout | 2022-05-05 11:07:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:07:58 UTC)" (scheduled at 2022-05-05 11:07:28.857216+00:00) gcworker stdout | 2022-05-05 11:07:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:07:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:07:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:07:30,230 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:07:30,242 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:07:30,275 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:07:30,291 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:07:30,296 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:07:30,302 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:07:30,313 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:07:30,314 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:07:30,319 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:07:30,327 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:07:30,330 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:07:30,337 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:07:30,354 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:07:30,349 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:07:30,361 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:07:30,365 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:07:30,949 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:07:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:07:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:35.685352+00:00 (in 2.899862 seconds) notificationworker stdout | 2022-05-05 11:07:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:32 UTC)" (scheduled at 2022-05-05 11:07:32.784864+00:00) notificationworker stdout | 2022-05-05 11:07:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:07:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:07:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:07:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:38.705240+00:00 (in 5.910217 seconds) namespacegcworker stdout | 2022-05-05 11:07:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:32 UTC)" (scheduled at 2022-05-05 11:07:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:07:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:07:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:32 UTC)" executed successfully expiredappspecifictokenworker stdout | 2022-05-05 11:07:34,827 [66] [DEBUG] [apscheduler.scheduler] Looking for jobs to run expiredappspecifictokenworker stdout | 2022-05-05 11:07:34,828 [66] [INFO] [apscheduler.executors.default] Running job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2022-05-05 11:07:34 UTC)" (scheduled at 2022-05-05 11:07:34.827355+00:00) expiredappspecifictokenworker stdout | 2022-05-05 11:07:34,828 [66] [DEBUG] [__main__] Garbage collecting expired app specific tokens with window: 1 day, 0:00:00 expiredappspecifictokenworker stdout | 2022-05-05 11:07:34,829 [66] [DEBUG] [peewee] ('DELETE FROM "appspecificauthtoken" WHERE ("appspecificauthtoken"."expiration" < %s)', [datetime.datetime(2022, 5, 4, 11, 7, 34, 828859)]) expiredappspecifictokenworker stdout | 2022-05-05 11:07:34,829 [66] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 12:07:34.827355+00:00 (in 3599.999502 seconds) expiredappspecifictokenworker stdout | 2022-05-05 11:07:34,839 [66] [DEBUG] [data.database] Disconnecting from database. expiredappspecifictokenworker stdout | 2022-05-05 11:07:34,839 [66] [INFO] [apscheduler.executors.default] Job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2022-05-05 12:07:34 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:07:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:07:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:45.685352+00:00 (in 9.999344 seconds) notificationworker stdout | 2022-05-05 11:07:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:45 UTC)" (scheduled at 2022-05-05 11:07:35.685352+00:00) notificationworker stdout | 2022-05-05 11:07:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:07:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 35, 686702), True, datetime.datetime(2022, 5, 5, 11, 7, 35, 686702), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:07:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:07:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:07:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:07:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:07:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:32.794430+00:00 (in 54.088634 seconds) namespacegcworker stdout | 2022-05-05 11:07:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:38 UTC)" (scheduled at 2022-05-05 11:07:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:07:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:07:38,708 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 38, 706452), True, datetime.datetime(2022, 5, 5, 11, 7, 38, 706452), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:07:38,719 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:07:38,719 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:07:38,719 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:07:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:07:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:55.685352+00:00 (in 9.999312 seconds) notificationworker stdout | 2022-05-05 11:07:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:55 UTC)" (scheduled at 2022-05-05 11:07:45.685352+00:00) notificationworker stdout | 2022-05-05 11:07:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:07:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 45, 686667), True, datetime.datetime(2022, 5, 5, 11, 7, 45, 686667), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:07:45,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:07:45,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:07:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:07:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:07:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:07:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:16.265236+00:00 (in 29.999374 seconds) buildlogsarchiver stdout | 2022-05-05 11:07:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:08:16 UTC)" (scheduled at 2022-05-05 11:07:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:07:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 7, 46, 266363), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:07:46,276 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:07:46,276 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:07:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:08:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:07:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:07:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:07:51.436849+00:00 (in 1.912339 seconds) repositorygcworker stdout | 2022-05-05 11:07:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:49 UTC)" (scheduled at 2022-05-05 11:07:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:07:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:07:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:07:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:07:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:47.516588+00:00 (in 56.079033 seconds) repositorygcworker stdout | 2022-05-05 11:07:51,438 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:51 UTC)" (scheduled at 2022-05-05 11:07:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:07:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:07:51,440 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 51, 438411), True, datetime.datetime(2022, 5, 5, 11, 7, 51, 438411), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:07:51,451 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:07:51,451 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:07:51,452 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:08:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:07:52,787 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:07:53,052 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:07:53,115 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:07:53,121 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositoryactioncounter stdout | 2022-05-05 11:07:53,187 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:07:53,194 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} builder stdout | 2022-05-05 11:07:53,201 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} notificationworker stdout | 2022-05-05 11:07:53,249 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:07:53,275 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:07:53,328 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:07:53,334 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:07:53,391 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:07:53,449 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:07:53,489 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} manifestbackfillworker stdout | 2022-05-05 11:07:53,498 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:07:53,526 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:07:53,566 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:07:53,707 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:07:53,801 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:07:54,408 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:07:54,413 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:07:54,421 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:07:54,429 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:07:54,436 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:07:54,483 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:07:54,488 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:07:54,501 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:07:54,507 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:07:54,513 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:07:54,531 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:07:54,541 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:07:54,547 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:07:54,555 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:07:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:07:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:05.685352+00:00 (in 9.999463 seconds) notificationworker stdout | 2022-05-05 11:07:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:05 UTC)" (scheduled at 2022-05-05 11:07:55.685352+00:00) notificationworker stdout | 2022-05-05 11:07:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:07:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 7, 55, 686457), True, datetime.datetime(2022, 5, 5, 11, 7, 55, 686457), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:07:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:07:55,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:07:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:05 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:07:56,000 [222] [DEBUG] [app] Starting request: urn:request:ae7ee838-ae61-4cab-8685-a7295d2d7faa (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:07:56,000 [222] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:07:56,001 [222] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:07:56,001 [222] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:07:56,001 [229] [DEBUG] [app] Starting request: urn:request:2ee7f503-7436-48d9-b5a9-c2feab23238e (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:07:56,002 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:07:56,002 [229] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:07:56,003 [229] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:07:56,003 [229] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:07:56,007 [229] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:07:56,014 [222] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:07:56,014 [222] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:07:56,014 [222] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:07:56,014 [222] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:07:56,014 [222] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:07:56,014 [222] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:07:56,014 [222] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:07:56,014 [222] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:07:56,015 [222] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:07:56,017 [222] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6]) gunicorn-web stdout | 2022-05-05 11:07:56,017 [229] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:07:56,019 [229] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:07:56,019 [229] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:07:56,019 [229] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:07:56,019 [229] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:07:56,019 [229] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:07:56,019 [229] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:07:56,019 [229] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:07:56,020 [229] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:07:56,021 [229] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2022, 5, 8, 6, 19, 56, 20413), datetime.datetime(2022, 5, 5, 11, 7, 56, 20542)]) gunicorn-web stdout | 2022-05-05 11:07:56,023 [229] [DEBUG] [app] Ending request: urn:request:2ee7f503-7436-48d9-b5a9-c2feab23238e (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:07:56,024 [229] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:07:56,024 [222] [DEBUG] [app] Ending request: urn:request:ae7ee838-ae61-4cab-8685-a7295d2d7faa (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:07:56,025 [229] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:07:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:07:56,025 [222] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:07:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.028 979 0.024) nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:07:56 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.029 970 0.028) gunicorn-web stdout | 2022-05-05 11:07:56,028 [222] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:07:56 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gcworker stdout | 2022-05-05 11:07:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:07:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:28.857216+00:00 (in 29.999315 seconds) gcworker stdout | 2022-05-05 11:07:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:08:28 UTC)" (scheduled at 2022-05-05 11:07:58.857216+00:00) gcworker stdout | 2022-05-05 11:07:58,859 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:07:58,859 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:08:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:08:00,246 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:08:00,258 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:08:00,290 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:08:00,307 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:08:00,318 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:08:00,324 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:08:00,331 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:08:00,337 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:08:00,342 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:08:00,348 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:08:00,353 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:08:00,358 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:08:00,364 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:08:00,371 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:08:00,379 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:08:00,385 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:08:02,119 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:08:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:08:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:15.685352+00:00 (in 9.999368 seconds) notificationworker stdout | 2022-05-05 11:08:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:15 UTC)" (scheduled at 2022-05-05 11:08:05.685352+00:00) notificationworker stdout | 2022-05-05 11:08:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:08:05,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 5, 686815), True, datetime.datetime(2022, 5, 5, 11, 8, 5, 686815), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:08:05,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:08:05,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:08:05,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:15 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:08:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:08:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:25.685352+00:00 (in 9.999203 seconds) notificationworker stdout | 2022-05-05 11:08:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:25 UTC)" (scheduled at 2022-05-05 11:08:15.685352+00:00) notificationworker stdout | 2022-05-05 11:08:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:08:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 15, 686827), True, datetime.datetime(2022, 5, 5, 11, 8, 15, 686827), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:08:15,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:08:15,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:08:15,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:08:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:08:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:46.265236+00:00 (in 29.999340 seconds) buildlogsarchiver stdout | 2022-05-05 11:08:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:08:46 UTC)" (scheduled at 2022-05-05 11:08:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:08:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 8, 16, 266398), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:08:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:08:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:08:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:08:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:08:22,822 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:08:23,092 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:08:23,149 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:08:23,158 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} repositoryactioncounter stdout | 2022-05-05 11:08:23,216 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} builder stdout | 2022-05-05 11:08:23,222 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:08:23,233 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:08:23,290 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:08:23,314 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:08:23,366 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:08:23,380 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:08:23,430 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:08:23,487 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:08:23,520 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:08:23,528 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:08:23,569 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:08:23,606 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:08:23,733 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:08:23,822 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:08:24,419 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:08:24,426 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:08:24,431 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:08:24,439 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:08:24,446 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:08:24,499 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:08:24,504 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:08:24,510 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:08:24,523 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:08:24,529 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:08:24,541 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:08:24,550 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:08:24,557 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:08:24,570 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:08:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:08:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:26.930811+00:00 (in 1.958535 seconds) exportactionlogsworker stdout | 2022-05-05 11:08:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:24 UTC)" (scheduled at 2022-05-05 11:08:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:08:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:08:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:08:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:08:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:32.784864+00:00 (in 7.098805 seconds) notificationworker stdout | 2022-05-05 11:08:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:35 UTC)" (scheduled at 2022-05-05 11:08:25.685352+00:00) notificationworker stdout | 2022-05-05 11:08:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:08:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 25, 686638), True, datetime.datetime(2022, 5, 5, 11, 8, 25, 686638), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:08:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:08:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:08:25,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:08:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:08:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:24.971405+00:00 (in 58.039862 seconds) exportactionlogsworker stdout | 2022-05-05 11:08:26,932 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:26 UTC)" (scheduled at 2022-05-05 11:08:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:08:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:08:26,934 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 26, 932345), True, datetime.datetime(2022, 5, 5, 11, 8, 26, 932345), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:08:26,945 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:08:26,945 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:08:26,946 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:08:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:08:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:58.857216+00:00 (in 29.999245 seconds) gcworker stdout | 2022-05-05 11:08:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:08:58 UTC)" (scheduled at 2022-05-05 11:08:28.857216+00:00) gcworker stdout | 2022-05-05 11:08:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:08:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:08:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:08:30,264 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:08:30,272 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:08:30,306 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:08:30,318 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:08:30,332 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:08:30,348 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:08:30,349 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:08:30,354 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:08:30,358 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:08:30,364 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:08:30,370 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:08:30,375 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:08:30,384 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:08:30,390 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:08:30,396 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:08:30,401 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:08:32,131 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:08:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:08:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:35.685352+00:00 (in 2.899918 seconds) notificationworker stdout | 2022-05-05 11:08:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:32 UTC)" (scheduled at 2022-05-05 11:08:32.784864+00:00) notificationworker stdout | 2022-05-05 11:08:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:08:32,785 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:08:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:08:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:38.705240+00:00 (in 5.910210 seconds) namespacegcworker stdout | 2022-05-05 11:08:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:32 UTC)" (scheduled at 2022-05-05 11:08:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:08:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:08:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:08:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:08:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:45.685352+00:00 (in 9.999448 seconds) notificationworker stdout | 2022-05-05 11:08:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:45 UTC)" (scheduled at 2022-05-05 11:08:35.685352+00:00) notificationworker stdout | 2022-05-05 11:08:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:08:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 35, 686438), True, datetime.datetime(2022, 5, 5, 11, 8, 35, 686438), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:08:35,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:08:35,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:08:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:08:38,706 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:08:38,708 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:09.794132+00:00 (in 31.087113 seconds) namespacegcworker stdout | 2022-05-05 11:08:38,709 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:38 UTC)" (scheduled at 2022-05-05 11:08:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:08:38,710 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:08:38,716 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 38, 710236), True, datetime.datetime(2022, 5, 5, 11, 8, 38, 710236), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:08:38,801 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:08:38,802 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:08:38,803 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:08:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:08:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:55.685352+00:00 (in 9.999397 seconds) notificationworker stdout | 2022-05-05 11:08:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:55 UTC)" (scheduled at 2022-05-05 11:08:45.685352+00:00) notificationworker stdout | 2022-05-05 11:08:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:08:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 45, 686561), True, datetime.datetime(2022, 5, 5, 11, 8, 45, 686561), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:08:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:08:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:08:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:08:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:08:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:08:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:16.265236+00:00 (in 29.999317 seconds) buildlogsarchiver stdout | 2022-05-05 11:08:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:09:16 UTC)" (scheduled at 2022-05-05 11:08:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:08:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 8, 46, 266548), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:08:46,279 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:08:46,279 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:08:46,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:09:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:08:47,517 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:08:47,517 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:49.523944+00:00 (in 2.006596 seconds) repositorygcworker stdout | 2022-05-05 11:08:47,517 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:13:47 UTC)" (scheduled at 2022-05-05 11:08:47.516588+00:00) repositorygcworker stdout | 2022-05-05 11:08:47,518 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 8, 47, 517937), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:08:47,533 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 8, 47, 517937), True, datetime.datetime(2022, 5, 5, 11, 8, 47, 517937), 0, 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:08:47,535 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 8, 47, 517937), True, datetime.datetime(2022, 5, 5, 11, 8, 47, 517937), 0, 'repositorygc/%', False, datetime.datetime(2022, 5, 5, 11, 8, 47, 517937), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:08:47,536 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:08:47,537 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:13:47 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:08:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:08:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:08:51.436849+00:00 (in 1.912306 seconds) repositorygcworker stdout | 2022-05-05 11:08:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:49 UTC)" (scheduled at 2022-05-05 11:08:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:08:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:08:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:08:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:08:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:49.523944+00:00 (in 58.086555 seconds) repositorygcworker stdout | 2022-05-05 11:08:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:51 UTC)" (scheduled at 2022-05-05 11:08:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:08:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:08:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 51, 438052), True, datetime.datetime(2022, 5, 5, 11, 8, 51, 438052), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:08:51,450 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:08:51,450 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:08:51,450 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:09:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:08:52,864 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:08:53,134 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:08:53,178 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:08:53,184 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} repositoryactioncounter stdout | 2022-05-05 11:08:53,247 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} builder stdout | 2022-05-05 11:08:53,253 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:08:53,269 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:08:53,325 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:08:53,353 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:08:53,404 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:08:53,418 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:08:53,472 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:08:53,516 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:08:53,560 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:08:53,565 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:08:53,609 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:08:53,641 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:08:53,775 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:08:53,863 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:08:54,433 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:08:54,440 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:08:54,446 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:08:54,452 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:08:54,458 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:08:54,512 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:08:54,519 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:08:54,524 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:08:54,536 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:08:54,542 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:08:54,551 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:08:54,560 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:08:54,566 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:08:54,584 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:08:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:08:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:05.685352+00:00 (in 9.999366 seconds) notificationworker stdout | 2022-05-05 11:08:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:05 UTC)" (scheduled at 2022-05-05 11:08:55.685352+00:00) notificationworker stdout | 2022-05-05 11:08:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:08:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 8, 55, 686627), True, datetime.datetime(2022, 5, 5, 11, 8, 55, 686627), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:08:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:08:55,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:08:55,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:08:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:08:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:28.857216+00:00 (in 29.999360 seconds) gcworker stdout | 2022-05-05 11:08:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:09:28 UTC)" (scheduled at 2022-05-05 11:08:58.857216+00:00) gcworker stdout | 2022-05-05 11:08:58,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:08:58,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:09:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:09:00,278 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:09:00,287 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:09:00,318 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:09:00,329 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:09:00,353 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:09:00,360 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:09:00,366 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:09:00,374 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:09:00,379 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:09:00,386 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:09:00,394 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:09:00,403 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:09:00,410 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:09:00,417 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:09:00,422 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:09:00,428 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:09:02,144 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:09:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:09:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:15.685352+00:00 (in 9.999321 seconds) notificationworker stdout | 2022-05-05 11:09:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:15 UTC)" (scheduled at 2022-05-05 11:09:05.685352+00:00) notificationworker stdout | 2022-05-05 11:09:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:09:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 5, 686574), True, datetime.datetime(2022, 5, 5, 11, 9, 5, 686574), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:09:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:09:05,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:09:05,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:15 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:09:09,795 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:09:09,796 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:32.794430+00:00 (in 22.998366 seconds) namespacegcworker stdout | 2022-05-05 11:09:09,796 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:14:09 UTC)" (scheduled at 2022-05-05 11:09:09.794132+00:00) namespacegcworker stdout | 2022-05-05 11:09:09,798 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 9, 9, 796973), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:09:09,807 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 9, 9, 796973), True, datetime.datetime(2022, 5, 5, 11, 9, 9, 796973), 0, 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:09:09,809 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 9, 9, 796973), True, datetime.datetime(2022, 5, 5, 11, 9, 9, 796973), 0, 'namespacegc/%', False, datetime.datetime(2022, 5, 5, 11, 9, 9, 796973), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:09:09,811 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:09:09,811 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:14:09 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:09:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:09:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:25.685352+00:00 (in 9.999357 seconds) notificationworker stdout | 2022-05-05 11:09:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:25 UTC)" (scheduled at 2022-05-05 11:09:15.685352+00:00) notificationworker stdout | 2022-05-05 11:09:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:09:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 15, 686701), True, datetime.datetime(2022, 5, 5, 11, 9, 15, 686701), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:09:15,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:09:15,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:09:15,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:09:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:09:16,267 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:46.265236+00:00 (in 29.999291 seconds) buildlogsarchiver stdout | 2022-05-05 11:09:16,267 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:09:46 UTC)" (scheduled at 2022-05-05 11:09:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:09:16,268 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 9, 16, 267578), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:09:16,280 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:09:16,280 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:09:16,281 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:09:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:09:22,904 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:09:23,145 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:09:23,195 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:09:23,221 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:09:23,284 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:09:23,289 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:09:23,305 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:09:23,336 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:09:23,389 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:09:23,448 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:09:23,456 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:09:23,512 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:09:23,558 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:09:23,596 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} manifestbackfillworker stdout | 2022-05-05 11:09:23,602 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:09:23,645 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:09:23,684 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:09:23,815 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:09:23,893 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:09:24,447 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:09:24,455 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:09:24,461 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:09:24,466 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:09:24,472 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:09:24,531 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:09:24,539 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:09:24,544 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:09:24,548 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:09:24,555 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:09:24,561 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:09:24,570 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:09:24,577 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:09:24,597 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:09:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:09:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:26.930811+00:00 (in 1.958644 seconds) exportactionlogsworker stdout | 2022-05-05 11:09:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:24 UTC)" (scheduled at 2022-05-05 11:09:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:09:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:09:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:09:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:09:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:32.784864+00:00 (in 7.098960 seconds) notificationworker stdout | 2022-05-05 11:09:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:35 UTC)" (scheduled at 2022-05-05 11:09:25.685352+00:00) notificationworker stdout | 2022-05-05 11:09:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:09:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 25, 686444), True, datetime.datetime(2022, 5, 5, 11, 9, 25, 686444), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:09:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:09:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:09:25,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:09:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:09:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:24.971405+00:00 (in 58.039835 seconds) exportactionlogsworker stdout | 2022-05-05 11:09:26,932 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:26 UTC)" (scheduled at 2022-05-05 11:09:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:09:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:09:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 26, 932302), True, datetime.datetime(2022, 5, 5, 11, 9, 26, 932302), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:09:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:09:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:09:26,943 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:09:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:09:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:58.857216+00:00 (in 29.999355 seconds) gcworker stdout | 2022-05-05 11:09:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:09:58 UTC)" (scheduled at 2022-05-05 11:09:28.857216+00:00) gcworker stdout | 2022-05-05 11:09:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:09:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:09:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:09:30,292 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:09:30,298 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:09:30,330 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:09:30,341 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:09:30,369 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:09:30,377 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:09:30,390 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:09:30,397 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:09:30,405 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:09:30,412 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:09:30,419 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:09:30,426 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:09:30,439 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:09:30,440 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:09:30,446 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:09:30,451 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:09:32,157 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:09:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:09:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:35.685352+00:00 (in 2.899937 seconds) notificationworker stdout | 2022-05-05 11:09:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:32 UTC)" (scheduled at 2022-05-05 11:09:32.784864+00:00) notificationworker stdout | 2022-05-05 11:09:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:09:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:09:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:09:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:38.705240+00:00 (in 5.910158 seconds) namespacegcworker stdout | 2022-05-05 11:09:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:32 UTC)" (scheduled at 2022-05-05 11:09:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:09:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:09:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:09:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:09:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:45.685352+00:00 (in 9.999473 seconds) notificationworker stdout | 2022-05-05 11:09:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:45 UTC)" (scheduled at 2022-05-05 11:09:35.685352+00:00) notificationworker stdout | 2022-05-05 11:09:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:09:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 35, 686452), True, datetime.datetime(2022, 5, 5, 11, 9, 35, 686452), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:09:35,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:09:35,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:09:35,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:09:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:09:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:32.794430+00:00 (in 54.088648 seconds) namespacegcworker stdout | 2022-05-05 11:09:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:38 UTC)" (scheduled at 2022-05-05 11:09:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:09:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:09:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 38, 706298), True, datetime.datetime(2022, 5, 5, 11, 9, 38, 706298), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:09:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:09:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:09:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:09:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:09:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:55.685352+00:00 (in 9.999358 seconds) notificationworker stdout | 2022-05-05 11:09:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:55 UTC)" (scheduled at 2022-05-05 11:09:45.685352+00:00) notificationworker stdout | 2022-05-05 11:09:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:09:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 45, 686640), True, datetime.datetime(2022, 5, 5, 11, 9, 45, 686640), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:09:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:09:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:09:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:09:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:09:46,266 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:09:46,267 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:16.265236+00:00 (in 29.998155 seconds) buildlogsarchiver stdout | 2022-05-05 11:09:46,267 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:10:16 UTC)" (scheduled at 2022-05-05 11:09:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:09:46,268 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 9, 46, 267601), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:09:46,280 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:09:46,280 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:09:46,280 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:10:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:09:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:09:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:09:51.436849+00:00 (in 1.912212 seconds) repositorygcworker stdout | 2022-05-05 11:09:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:49 UTC)" (scheduled at 2022-05-05 11:09:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:09:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:09:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:09:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:09:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:49.523944+00:00 (in 58.086307 seconds) repositorygcworker stdout | 2022-05-05 11:09:51,438 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:51 UTC)" (scheduled at 2022-05-05 11:09:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:09:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:09:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 51, 438199), True, datetime.datetime(2022, 5, 5, 11, 9, 51, 438199), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:09:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:09:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:09:51,450 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:10:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:09:52,941 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:09:53,185 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:09:53,231 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:09:53,257 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:09:53,316 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:09:53,323 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:09:53,345 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:09:53,356 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:09:53,407 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:09:53,459 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:09:53,496 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:09:53,535 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:09:53,598 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:09:53,621 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:09:53,632 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:09:53,686 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:09:53,722 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:09:53,845 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:09:53,909 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:09:54,461 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:09:54,468 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:09:54,474 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:09:54,480 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:09:54,484 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:09:54,545 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:09:54,551 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:09:54,559 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:09:54,564 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:09:54,570 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:09:54,576 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:09:54,582 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:09:54,587 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:09:54,607 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:09:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:09:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:05.685352+00:00 (in 9.999372 seconds) notificationworker stdout | 2022-05-05 11:09:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:05 UTC)" (scheduled at 2022-05-05 11:09:55.685352+00:00) notificationworker stdout | 2022-05-05 11:09:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:09:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 9, 55, 686573), True, datetime.datetime(2022, 5, 5, 11, 9, 55, 686573), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:09:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:09:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:09:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:09:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:09:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:28.857216+00:00 (in 29.999354 seconds) gcworker stdout | 2022-05-05 11:09:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:10:28 UTC)" (scheduled at 2022-05-05 11:09:58.857216+00:00) gcworker stdout | 2022-05-05 11:09:58,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:09:58,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:10:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:10:00,307 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:10:00,312 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:10:00,346 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:10:00,352 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:10:00,389 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:10:00,394 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:10:00,402 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:10:00,408 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:10:00,415 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:10:00,429 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:10:00,434 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:10:00,442 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:10:00,451 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:10:00,456 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:10:00,461 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:10:00,467 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:10:04,085 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:10:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:10:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:15.685352+00:00 (in 9.999367 seconds) notificationworker stdout | 2022-05-05 11:10:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:15 UTC)" (scheduled at 2022-05-05 11:10:05.685352+00:00) notificationworker stdout | 2022-05-05 11:10:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:10:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 5, 686534), True, datetime.datetime(2022, 5, 5, 11, 10, 5, 686534), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:10:05,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:10:05,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:10:05,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:15 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:10:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:10:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:25.685352+00:00 (in 9.999301 seconds) notificationworker stdout | 2022-05-05 11:10:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:25 UTC)" (scheduled at 2022-05-05 11:10:15.685352+00:00) notificationworker stdout | 2022-05-05 11:10:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:10:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 15, 686704), True, datetime.datetime(2022, 5, 5, 11, 10, 15, 686704), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:10:15,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:10:15,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:10:15,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:10:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:10:16,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:46.265236+00:00 (in 29.999433 seconds) buildlogsarchiver stdout | 2022-05-05 11:10:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:10:46 UTC)" (scheduled at 2022-05-05 11:10:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:10:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 10, 16, 266310), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:10:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:10:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:10:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:10:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:10:22,980 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:10:23,226 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:10:23,272 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:10:23,279 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:10:23,352 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:10:23,362 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:10:23,382 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:10:23,394 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:10:23,442 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:10:23,497 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:10:23,534 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:10:23,560 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:10:23,639 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:10:23,645 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:10:23,670 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:10:23,728 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:10:23,761 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:10:23,883 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:10:23,945 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:10:24,472 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:10:24,477 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:10:24,484 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:10:24,495 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:10:24,501 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:10:24,557 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:10:24,563 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:10:24,570 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:10:24,577 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:10:24,582 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:10:24,590 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:10:24,597 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:10:24,601 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:10:24,616 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:10:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:10:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:26.930811+00:00 (in 1.958600 seconds) exportactionlogsworker stdout | 2022-05-05 11:10:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:24 UTC)" (scheduled at 2022-05-05 11:10:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:10:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:10:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:10:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:10:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:31.783119+00:00 (in 6.097088 seconds) notificationworker stdout | 2022-05-05 11:10:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:35 UTC)" (scheduled at 2022-05-05 11:10:25.685352+00:00) notificationworker stdout | 2022-05-05 11:10:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:10:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 25, 686558), True, datetime.datetime(2022, 5, 5, 11, 10, 25, 686558), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:10:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:10:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:10:25,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:10:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:10:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:24.970422+00:00 (in 58.038723 seconds) exportactionlogsworker stdout | 2022-05-05 11:10:26,932 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:26 UTC)" (scheduled at 2022-05-05 11:10:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:10:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:10:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 26, 932414), True, datetime.datetime(2022, 5, 5, 11, 10, 26, 932414), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:10:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:10:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:10:26,943 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:10:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:10:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:58.857216+00:00 (in 29.999403 seconds) gcworker stdout | 2022-05-05 11:10:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:10:58 UTC)" (scheduled at 2022-05-05 11:10:28.857216+00:00) gcworker stdout | 2022-05-05 11:10:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:10:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:10:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:10:30,318 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:10:30,325 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:10:30,359 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:10:30,366 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:10:30,407 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:10:30,413 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:10:30,419 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:10:30,424 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:10:30,430 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:10:30,441 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:10:30,448 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:10:30,455 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:10:30,460 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:10:30,470 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:10:30,474 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:10:30,479 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:10:31,783 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:10:31,783 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:32.784864+00:00 (in 1.001185 seconds) notificationworker stdout | 2022-05-05 11:10:31,784 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:15:31 UTC)" (scheduled at 2022-05-05 11:10:31.783119+00:00) notificationworker stdout | 2022-05-05 11:10:31,784 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 10, 31, 784205), 'notification/%']) notificationworker stdout | 2022-05-05 11:10:31,794 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 10, 31, 784205), True, datetime.datetime(2022, 5, 5, 11, 10, 31, 784205), 0, 'notification/%']) notificationworker stdout | 2022-05-05 11:10:31,797 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 10, 31, 784205), True, datetime.datetime(2022, 5, 5, 11, 10, 31, 784205), 0, 'notification/%', False, datetime.datetime(2022, 5, 5, 11, 10, 31, 784205), 'notification/%']) notificationworker stdout | 2022-05-05 11:10:31,798 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:10:31,798 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:15:31 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:10:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:10:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:35.685352+00:00 (in 2.899911 seconds) notificationworker stdout | 2022-05-05 11:10:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:32 UTC)" (scheduled at 2022-05-05 11:10:32.784864+00:00) notificationworker stdout | 2022-05-05 11:10:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:10:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:10:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:10:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:38.705240+00:00 (in 5.910287 seconds) namespacegcworker stdout | 2022-05-05 11:10:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:32 UTC)" (scheduled at 2022-05-05 11:10:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:10:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:10:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:32 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:10:35,304 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:10:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:10:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:45.685352+00:00 (in 9.999288 seconds) notificationworker stdout | 2022-05-05 11:10:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:45 UTC)" (scheduled at 2022-05-05 11:10:35.685352+00:00) notificationworker stdout | 2022-05-05 11:10:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:10:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 35, 686829), True, datetime.datetime(2022, 5, 5, 11, 10, 35, 686829), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:10:35,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:10:35,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:10:35,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:10:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:10:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:32.794430+00:00 (in 54.088586 seconds) namespacegcworker stdout | 2022-05-05 11:10:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:38 UTC)" (scheduled at 2022-05-05 11:10:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:10:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:10:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 38, 706363), True, datetime.datetime(2022, 5, 5, 11, 10, 38, 706363), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:10:38,718 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:10:38,718 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:10:38,718 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:10:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:10:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:55.685352+00:00 (in 9.999393 seconds) notificationworker stdout | 2022-05-05 11:10:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:55 UTC)" (scheduled at 2022-05-05 11:10:45.685352+00:00) notificationworker stdout | 2022-05-05 11:10:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:10:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 45, 686484), True, datetime.datetime(2022, 5, 5, 11, 10, 45, 686484), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:10:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:10:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:10:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:10:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:10:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:10:46,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:16.265236+00:00 (in 29.999451 seconds) buildlogsarchiver stdout | 2022-05-05 11:10:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:11:16 UTC)" (scheduled at 2022-05-05 11:10:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:10:46,266 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 10, 46, 266277), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:10:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:10:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:10:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:11:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:10:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:10:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:10:51.436849+00:00 (in 1.912316 seconds) repositorygcworker stdout | 2022-05-05 11:10:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:49 UTC)" (scheduled at 2022-05-05 11:10:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:10:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:10:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:10:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:10:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:49.523944+00:00 (in 58.086484 seconds) repositorygcworker stdout | 2022-05-05 11:10:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:51 UTC)" (scheduled at 2022-05-05 11:10:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:10:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:10:51,443 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 51, 437986), True, datetime.datetime(2022, 5, 5, 11, 10, 51, 437986), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:10:51,453 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:10:51,453 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:10:51,453 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:11:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:10:53,020 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:10:53,242 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:10:53,287 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:10:53,292 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:10:53,386 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:10:53,401 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:10:53,418 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:10:53,427 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:10:53,474 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:10:53,538 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:10:53,574 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:10:53,579 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:10:53,675 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:10:53,681 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:10:53,710 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:10:53,768 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:10:53,795 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:10:53,923 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:10:53,978 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:10:54,486 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:10:54,492 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:10:54,497 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:10:54,510 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:10:54,515 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:10:54,569 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:10:54,576 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:10:54,582 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:10:54,588 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:10:54,593 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:10:54,603 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:10:54,609 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:10:54,614 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:10:54,625 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:10:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:10:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:05.685352+00:00 (in 9.999394 seconds) notificationworker stdout | 2022-05-05 11:10:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:05 UTC)" (scheduled at 2022-05-05 11:10:55.685352+00:00) notificationworker stdout | 2022-05-05 11:10:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:10:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 10, 55, 686609), True, datetime.datetime(2022, 5, 5, 11, 10, 55, 686609), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:10:55,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:10:55,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:10:55,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:10:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:10:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:28.857216+00:00 (in 29.999374 seconds) gcworker stdout | 2022-05-05 11:10:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:11:28 UTC)" (scheduled at 2022-05-05 11:10:58.857216+00:00) gcworker stdout | 2022-05-05 11:10:58,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:10:58,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:11:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:11:00,332 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:11:00,338 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:11:00,372 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:11:00,383 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:11:00,422 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:11:00,429 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:11:00,434 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:11:00,440 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:11:00,445 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:11:00,452 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:11:00,466 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:11:00,471 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:11:00,482 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:11:00,489 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:11:00,495 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:11:00,500 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:11:05,319 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:11:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:11:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:15.685352+00:00 (in 9.999312 seconds) notificationworker stdout | 2022-05-05 11:11:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:15 UTC)" (scheduled at 2022-05-05 11:11:05.685352+00:00) notificationworker stdout | 2022-05-05 11:11:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:11:05,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 5, 686677), True, datetime.datetime(2022, 5, 5, 11, 11, 5, 686677), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:11:05,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:11:05,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:11:05,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:15 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:11:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:11:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:25.685352+00:00 (in 9.999363 seconds) notificationworker stdout | 2022-05-05 11:11:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:25 UTC)" (scheduled at 2022-05-05 11:11:15.685352+00:00) notificationworker stdout | 2022-05-05 11:11:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:11:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 15, 686525), True, datetime.datetime(2022, 5, 5, 11, 11, 15, 686525), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:11:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:11:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:11:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:11:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:11:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:46.265236+00:00 (in 29.999381 seconds) buildlogsarchiver stdout | 2022-05-05 11:11:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:11:46 UTC)" (scheduled at 2022-05-05 11:11:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:11:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 11, 16, 266395), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:11:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:11:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:11:16,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:11:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:11:23,061 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:11:23,270 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:11:23,327 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:11:23,334 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:11:23,434 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:11:23,439 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:11:23,459 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:11:23,467 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:11:23,502 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:11:23,576 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:11:23,614 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:11:23,620 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:11:23,700 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} expiredappspecifictokenworker stdout | 2022-05-05 11:11:23,712 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:11:23,752 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:11:23,808 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:11:23,834 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:11:23,964 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:11:24,017 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:11:24,498 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:11:24,505 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:11:24,511 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:11:24,520 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:11:24,525 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:11:24,582 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:11:24,590 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:11:24,597 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:11:24,602 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:11:24,610 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:11:24,619 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:11:24,624 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:11:24,629 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:11:24,635 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:11:24,970 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:11:24,971 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:24.971405+00:00 (in 0.000256 seconds) exportactionlogsworker stdout | 2022-05-05 11:11:24,971 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:16:24 UTC)" (scheduled at 2022-05-05 11:11:24.970422+00:00) exportactionlogsworker stdout | 2022-05-05 11:11:24,972 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 11, 24, 971595), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:11:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:11:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:26.930811+00:00 (in 1.958100 seconds) exportactionlogsworker stdout | 2022-05-05 11:11:24,973 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:24 UTC)" (scheduled at 2022-05-05 11:11:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:11:24,973 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:11:24,973 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:24 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:11:24,981 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 11, 24, 971595), True, datetime.datetime(2022, 5, 5, 11, 11, 24, 971595), 0, 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:11:24,983 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 11, 24, 971595), True, datetime.datetime(2022, 5, 5, 11, 11, 24, 971595), 0, 'exportactionlogs/%', False, datetime.datetime(2022, 5, 5, 11, 11, 24, 971595), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:11:24,986 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:11:24,986 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:16:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:11:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:11:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:32.784864+00:00 (in 7.098866 seconds) notificationworker stdout | 2022-05-05 11:11:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:35 UTC)" (scheduled at 2022-05-05 11:11:25.685352+00:00) notificationworker stdout | 2022-05-05 11:11:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:11:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 25, 686648), True, datetime.datetime(2022, 5, 5, 11, 11, 25, 686648), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:11:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:11:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:11:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:11:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:11:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:24.971405+00:00 (in 58.040022 seconds) exportactionlogsworker stdout | 2022-05-05 11:11:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:26 UTC)" (scheduled at 2022-05-05 11:11:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:11:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:11:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 26, 932099), True, datetime.datetime(2022, 5, 5, 11, 11, 26, 932099), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:11:26,945 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:11:26,945 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:11:26,945 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:11:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:11:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:58.857216+00:00 (in 29.999371 seconds) gcworker stdout | 2022-05-05 11:11:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:11:58 UTC)" (scheduled at 2022-05-05 11:11:28.857216+00:00) gcworker stdout | 2022-05-05 11:11:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:11:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:11:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:11:30,346 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:11:30,351 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:11:30,385 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:11:30,398 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:11:30,442 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:11:30,447 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:11:30,454 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:11:30,459 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:11:30,464 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:11:30,472 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:11:30,479 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:11:30,484 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:11:30,492 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:11:30,500 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:11:30,511 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:11:30,517 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:11:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:11:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:35.685352+00:00 (in 2.899828 seconds) notificationworker stdout | 2022-05-05 11:11:32,786 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:32 UTC)" (scheduled at 2022-05-05 11:11:32.784864+00:00) notificationworker stdout | 2022-05-05 11:11:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:11:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:11:32,795 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:11:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:38.705240+00:00 (in 5.910022 seconds) namespacegcworker stdout | 2022-05-05 11:11:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:32 UTC)" (scheduled at 2022-05-05 11:11:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:11:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:11:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:32 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:11:35,335 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:11:35,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:11:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:45.685352+00:00 (in 9.998985 seconds) notificationworker stdout | 2022-05-05 11:11:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:45 UTC)" (scheduled at 2022-05-05 11:11:35.685352+00:00) notificationworker stdout | 2022-05-05 11:11:35,687 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:11:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 35, 687112), True, datetime.datetime(2022, 5, 5, 11, 11, 35, 687112), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:11:35,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:11:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:11:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:11:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:11:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:32.794430+00:00 (in 54.088632 seconds) namespacegcworker stdout | 2022-05-05 11:11:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:38 UTC)" (scheduled at 2022-05-05 11:11:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:11:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:11:38,708 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 38, 706370), True, datetime.datetime(2022, 5, 5, 11, 11, 38, 706370), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:11:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:11:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:11:38,718 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:11:45,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:11:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:55.685352+00:00 (in 9.999193 seconds) notificationworker stdout | 2022-05-05 11:11:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:55 UTC)" (scheduled at 2022-05-05 11:11:45.685352+00:00) notificationworker stdout | 2022-05-05 11:11:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:11:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 45, 686682), True, datetime.datetime(2022, 5, 5, 11, 11, 45, 686682), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:11:45,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:11:45,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:11:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:11:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:11:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:11:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:16.265236+00:00 (in 29.999406 seconds) buildlogsarchiver stdout | 2022-05-05 11:11:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:12:16 UTC)" (scheduled at 2022-05-05 11:11:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:11:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 11, 46, 266377), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:11:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:11:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:11:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:12:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:11:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:11:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:11:51.436849+00:00 (in 1.912352 seconds) repositorygcworker stdout | 2022-05-05 11:11:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:49 UTC)" (scheduled at 2022-05-05 11:11:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:11:49,524 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:11:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:11:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:11:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:49.523944+00:00 (in 58.086528 seconds) repositorygcworker stdout | 2022-05-05 11:11:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:51 UTC)" (scheduled at 2022-05-05 11:11:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:11:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:11:51,438 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 51, 437934), True, datetime.datetime(2022, 5, 5, 11, 11, 51, 437934), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:11:51,456 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:11:51,456 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:11:51,456 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:12:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:11:53,088 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:11:53,313 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:11:53,363 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:11:53,374 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:11:53,450 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:11:53,477 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:11:53,488 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:11:53,503 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:11:53,529 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:11:53,605 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:11:53,650 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:11:53,657 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:11:53,712 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} expiredappspecifictokenworker stdout | 2022-05-05 11:11:53,729 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:11:53,792 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:11:53,846 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:11:53,852 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:11:54,005 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:11:54,058 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:11:54,512 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:11:54,535 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:11:54,540 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:11:54,545 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:11:54,551 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:11:54,597 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:11:54,602 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:11:54,608 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:11:54,613 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:11:54,622 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:11:54,629 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:11:54,643 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:11:54,649 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:11:54,654 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:11:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:11:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:05.685352+00:00 (in 9.999346 seconds) notificationworker stdout | 2022-05-05 11:11:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:05 UTC)" (scheduled at 2022-05-05 11:11:55.685352+00:00) notificationworker stdout | 2022-05-05 11:11:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:11:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 11, 55, 686594), True, datetime.datetime(2022, 5, 5, 11, 11, 55, 686594), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:11:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:11:55,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:11:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:11:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:11:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:28.857216+00:00 (in 29.999444 seconds) gcworker stdout | 2022-05-05 11:11:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:12:28 UTC)" (scheduled at 2022-05-05 11:11:58.857216+00:00) gcworker stdout | 2022-05-05 11:11:58,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:11:58,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:12:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:12:00,364 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:12:00,368 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:12:00,396 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:12:00,412 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:12:00,459 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:12:00,463 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:12:00,471 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:12:00,476 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:12:00,482 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:12:00,491 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:12:00,498 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:12:00,503 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:12:00,508 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:12:00,516 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:12:00,523 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:12:00,530 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:12:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:12:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:15.685352+00:00 (in 9.999206 seconds) notificationworker stdout | 2022-05-05 11:12:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:15 UTC)" (scheduled at 2022-05-05 11:12:05.685352+00:00) notificationworker stdout | 2022-05-05 11:12:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:12:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 5, 686854), True, datetime.datetime(2022, 5, 5, 11, 12, 5, 686854), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:12:05,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:12:05,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:12:05,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:12:06,438 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:12:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:12:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:25.685352+00:00 (in 9.999222 seconds) notificationworker stdout | 2022-05-05 11:12:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:25 UTC)" (scheduled at 2022-05-05 11:12:15.685352+00:00) notificationworker stdout | 2022-05-05 11:12:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:12:15,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 15, 686763), True, datetime.datetime(2022, 5, 5, 11, 12, 15, 686763), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:12:15,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:12:15,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:12:15,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:12:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:12:16,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:46.265236+00:00 (in 29.999478 seconds) buildlogsarchiver stdout | 2022-05-05 11:12:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:12:46 UTC)" (scheduled at 2022-05-05 11:12:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:12:16,266 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 12, 16, 266239), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:12:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:12:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:12:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:12:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:12:23,106 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:12:23,353 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:12:23,405 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:12:23,412 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:12:23,479 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:12:23,508 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:12:23,514 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:12:23,542 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:12:23,568 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:12:23,646 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:12:23,690 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:12:23,697 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:12:23,755 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} expiredappspecifictokenworker stdout | 2022-05-05 11:12:23,761 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:12:23,833 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:12:23,890 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:12:23,895 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:12:24,019 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:12:24,098 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:12:24,524 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:12:24,547 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:12:24,552 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:12:24,558 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:12:24,564 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:12:24,608 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:12:24,617 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:12:24,622 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:12:24,630 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:12:24,636 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:12:24,641 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:12:24,653 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:12:24,660 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:12:24,666 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:12:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:12:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:26.930811+00:00 (in 1.958728 seconds) exportactionlogsworker stdout | 2022-05-05 11:12:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:24 UTC)" (scheduled at 2022-05-05 11:12:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:12:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:12:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:12:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:12:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:32.784864+00:00 (in 7.098781 seconds) notificationworker stdout | 2022-05-05 11:12:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:35 UTC)" (scheduled at 2022-05-05 11:12:25.685352+00:00) notificationworker stdout | 2022-05-05 11:12:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:12:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 25, 686611), True, datetime.datetime(2022, 5, 5, 11, 12, 25, 686611), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:12:25,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:12:25,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:12:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:12:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:12:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:24.971405+00:00 (in 58.039798 seconds) exportactionlogsworker stdout | 2022-05-05 11:12:26,932 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:26 UTC)" (scheduled at 2022-05-05 11:12:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:12:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:12:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 26, 932213), True, datetime.datetime(2022, 5, 5, 11, 12, 26, 932213), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:12:26,944 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:12:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:12:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:12:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:12:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:58.857216+00:00 (in 29.999355 seconds) gcworker stdout | 2022-05-05 11:12:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:12:58 UTC)" (scheduled at 2022-05-05 11:12:28.857216+00:00) gcworker stdout | 2022-05-05 11:12:28,858 [68] [DEBUG] [__main__] No GC policies found gcworker stdout | 2022-05-05 11:12:28,858 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:12:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:12:30,380 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:12:30,387 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:12:30,412 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:12:30,422 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:12:30,477 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:12:30,483 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:12:30,488 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:12:30,494 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:12:30,502 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:12:30,508 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:12:30,514 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:12:30,520 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:12:30,526 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:12:30,531 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:12:30,537 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:12:30,541 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:12:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:12:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:35.685352+00:00 (in 2.899855 seconds) notificationworker stdout | 2022-05-05 11:12:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:32 UTC)" (scheduled at 2022-05-05 11:12:32.784864+00:00) notificationworker stdout | 2022-05-05 11:12:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:12:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:12:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:12:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:38.705240+00:00 (in 5.910288 seconds) namespacegcworker stdout | 2022-05-05 11:12:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:32 UTC)" (scheduled at 2022-05-05 11:12:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:12:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:12:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:12:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:12:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:45.685352+00:00 (in 9.999366 seconds) notificationworker stdout | 2022-05-05 11:12:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:45 UTC)" (scheduled at 2022-05-05 11:12:35.685352+00:00) notificationworker stdout | 2022-05-05 11:12:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:12:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 35, 686550), True, datetime.datetime(2022, 5, 5, 11, 12, 35, 686550), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:12:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:12:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:12:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:12:37,774 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} namespacegcworker stdout | 2022-05-05 11:12:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:12:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:32.794430+00:00 (in 54.088646 seconds) namespacegcworker stdout | 2022-05-05 11:12:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:38 UTC)" (scheduled at 2022-05-05 11:12:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:12:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:12:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 38, 706318), True, datetime.datetime(2022, 5, 5, 11, 12, 38, 706318), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:12:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:12:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:12:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:12:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:12:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:55.685352+00:00 (in 9.999353 seconds) notificationworker stdout | 2022-05-05 11:12:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:55 UTC)" (scheduled at 2022-05-05 11:12:45.685352+00:00) notificationworker stdout | 2022-05-05 11:12:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:12:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 45, 686594), True, datetime.datetime(2022, 5, 5, 11, 12, 45, 686594), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:12:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:12:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:12:45,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:12:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:12:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:12:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:16.265236+00:00 (in 29.999422 seconds) buildlogsarchiver stdout | 2022-05-05 11:12:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:13:16 UTC)" (scheduled at 2022-05-05 11:12:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:12:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 12, 46, 266366), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:12:46,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:12:46,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:12:46,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:13:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:12:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:12:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:12:51.436849+00:00 (in 1.912209 seconds) repositorygcworker stdout | 2022-05-05 11:12:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:49 UTC)" (scheduled at 2022-05-05 11:12:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:12:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:12:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:12:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:12:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:47.516588+00:00 (in 56.079054 seconds) repositorygcworker stdout | 2022-05-05 11:12:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:51 UTC)" (scheduled at 2022-05-05 11:12:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:12:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:12:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 51, 438071), True, datetime.datetime(2022, 5, 5, 11, 12, 51, 438071), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:12:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:12:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:12:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:13:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:12:53,142 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:12:53,388 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:12:53,443 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:12:53,449 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:12:53,492 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:12:53,546 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:12:53,551 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:12:53,581 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:12:53,606 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:12:53,686 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:12:53,716 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:12:53,742 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:12:53,781 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} expiredappspecifictokenworker stdout | 2022-05-05 11:12:53,801 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:12:53,848 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:12:53,922 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:12:53,932 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:12:54,051 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:12:54,123 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:12:54,538 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:12:54,560 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:12:54,566 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:12:54,573 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:12:54,578 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:12:54,624 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:12:54,632 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:12:54,638 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:12:54,646 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:12:54,652 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:12:54,657 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:12:54,663 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:12:54,672 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:12:54,684 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:12:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:12:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:05.685352+00:00 (in 9.999360 seconds) notificationworker stdout | 2022-05-05 11:12:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:05 UTC)" (scheduled at 2022-05-05 11:12:55.685352+00:00) notificationworker stdout | 2022-05-05 11:12:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:12:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 12, 55, 686730), True, datetime.datetime(2022, 5, 5, 11, 12, 55, 686730), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:12:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:12:55,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:12:55,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:05 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:12:56,182 [229] [DEBUG] [app] Starting request: urn:request:28bb04ff-a544-4dff-8a37-6b4bbe47460b (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:12:56,182 [229] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:12:56,182 [229] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:12:56,182 [229] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:12:56,183 [229] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:12:56,186 [228] [DEBUG] [app] Starting request: urn:request:7384e628-c542-4165-a744-c1bbdf487b32 (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:12:56,186 [228] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:12:56,187 [228] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:12:56,187 [228] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:12:56,190 [228] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:12:56,194 [229] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:12:56,195 [229] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:12:56,195 [229] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:12:56,195 [229] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:12:56,195 [229] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:12:56,195 [229] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:12:56,195 [229] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:12:56,195 [229] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:12:56,195 [229] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:12:56,197 [229] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6]) gunicorn-web stdout | 2022-05-05 11:12:56,203 [229] [DEBUG] [app] Ending request: urn:request:28bb04ff-a544-4dff-8a37-6b4bbe47460b (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:12:56,204 [229] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:12:56 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.025 970 0.024) gunicorn-web stdout | 2022-05-05 11:12:56,205 [229] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:12:56 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:12:56,202 [228] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:12:56,206 [228] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:12:56,206 [228] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:12:56,207 [228] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:12:56,207 [228] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:12:56,207 [228] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:12:56,207 [228] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:12:56,207 [228] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:12:56,208 [228] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:12:56,209 [228] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2022, 5, 8, 6, 24, 56, 208528), datetime.datetime(2022, 5, 5, 11, 12, 56, 208680)]) gunicorn-web stdout | 2022-05-05 11:12:56,213 [228] [DEBUG] [app] Ending request: urn:request:7384e628-c542-4165-a744-c1bbdf487b32 (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:12:56,214 [228] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:12:56,215 [228] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:12:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:12:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.034 979 0.032) gcworker stdout | 2022-05-05 11:12:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:12:58,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:28.857216+00:00 (in 29.999438 seconds) gcworker stdout | 2022-05-05 11:12:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:13:28 UTC)" (scheduled at 2022-05-05 11:12:58.857216+00:00) gcworker stdout | 2022-05-05 11:12:58,858 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100]) gcworker stdout | 2022-05-05 11:12:58,869 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539578868, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:12:58,873 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:12:58,873 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:12:58,873 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:13:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:13:00,394 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:13:00,400 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:13:00,429 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:13:00,434 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:13:00,489 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:13:00,498 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:13:00,505 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:13:00,509 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:13:00,515 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:13:00,526 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:13:00,532 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:13:00,537 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:13:00,543 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:13:00,548 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:13:00,554 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:13:00,559 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:13:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:13:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:15.685352+00:00 (in 9.999437 seconds) notificationworker stdout | 2022-05-05 11:13:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:15 UTC)" (scheduled at 2022-05-05 11:13:05.685352+00:00) notificationworker stdout | 2022-05-05 11:13:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:13:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 5, 686435), True, datetime.datetime(2022, 5, 5, 11, 13, 5, 686435), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:13:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:13:05,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:13:05,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:13:07,787 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:13:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:13:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:25.685352+00:00 (in 9.999460 seconds) notificationworker stdout | 2022-05-05 11:13:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:25 UTC)" (scheduled at 2022-05-05 11:13:15.685352+00:00) notificationworker stdout | 2022-05-05 11:13:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:13:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 15, 686430), True, datetime.datetime(2022, 5, 5, 11, 13, 15, 686430), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:13:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:13:15,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:13:15,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:13:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:13:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:46.265236+00:00 (in 29.999413 seconds) buildlogsarchiver stdout | 2022-05-05 11:13:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:13:46 UTC)" (scheduled at 2022-05-05 11:13:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:13:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 13, 16, 266252), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:13:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:13:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:13:16,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:13:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:13:23,182 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:13:23,431 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:13:23,483 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:13:23,489 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:13:23,525 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:13:23,583 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:13:23,589 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:13:23,623 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:13:23,646 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:13:23,727 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:13:23,746 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:13:23,780 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:13:23,822 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} expiredappspecifictokenworker stdout | 2022-05-05 11:13:23,833 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:13:23,872 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:13:23,950 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:13:23,961 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:13:24,093 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:13:24,154 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:13:24,558 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:13:24,575 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:13:24,581 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:13:24,587 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:13:24,592 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:13:24,638 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:13:24,644 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:13:24,649 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:13:24,658 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:13:24,668 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:13:24,675 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:13:24,680 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:13:24,686 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:13:24,694 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:13:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:13:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:26.930811+00:00 (in 1.958693 seconds) exportactionlogsworker stdout | 2022-05-05 11:13:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:24 UTC)" (scheduled at 2022-05-05 11:13:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:13:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:13:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:13:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:13:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:32.784864+00:00 (in 7.098958 seconds) notificationworker stdout | 2022-05-05 11:13:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:35 UTC)" (scheduled at 2022-05-05 11:13:25.685352+00:00) notificationworker stdout | 2022-05-05 11:13:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:13:25,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 25, 686576), True, datetime.datetime(2022, 5, 5, 11, 13, 25, 686576), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:13:25,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:13:25,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:13:25,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:13:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:13:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:24.971405+00:00 (in 58.040041 seconds) exportactionlogsworker stdout | 2022-05-05 11:13:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:26 UTC)" (scheduled at 2022-05-05 11:13:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:13:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:13:26,934 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 26, 932006), True, datetime.datetime(2022, 5, 5, 11, 13, 26, 932006), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:13:26,947 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:13:26,947 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:13:26,947 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:13:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:13:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:58.857216+00:00 (in 29.999255 seconds) gcworker stdout | 2022-05-05 11:13:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:13:58 UTC)" (scheduled at 2022-05-05 11:13:28.857216+00:00) gcworker stdout | 2022-05-05 11:13:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539608858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:13:28,873 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:13:28,873 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:13:28,873 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:13:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:13:30,411 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:13:30,428 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:13:30,441 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:13:30,447 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:13:30,503 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:13:30,518 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:13:30,523 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:13:30,533 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:13:30,542 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:13:30,553 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:13:30,555 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:13:30,563 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:13:30,573 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:13:30,574 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:13:30,579 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:13:30,584 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:13:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:13:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:35.685352+00:00 (in 2.899795 seconds) notificationworker stdout | 2022-05-05 11:13:32,786 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:32 UTC)" (scheduled at 2022-05-05 11:13:32.784864+00:00) notificationworker stdout | 2022-05-05 11:13:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:13:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:13:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:13:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:38.705240+00:00 (in 5.910226 seconds) namespacegcworker stdout | 2022-05-05 11:13:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:32 UTC)" (scheduled at 2022-05-05 11:13:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:13:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:13:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:13:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:13:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:45.685352+00:00 (in 9.999250 seconds) notificationworker stdout | 2022-05-05 11:13:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:45 UTC)" (scheduled at 2022-05-05 11:13:35.685352+00:00) notificationworker stdout | 2022-05-05 11:13:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:13:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 35, 686631), True, datetime.datetime(2022, 5, 5, 11, 13, 35, 686631), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:13:35,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:13:35,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:13:35,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:13:37,801 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} namespacegcworker stdout | 2022-05-05 11:13:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:13:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:09.794132+00:00 (in 31.088268 seconds) namespacegcworker stdout | 2022-05-05 11:13:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:38 UTC)" (scheduled at 2022-05-05 11:13:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:13:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:13:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 38, 706505), True, datetime.datetime(2022, 5, 5, 11, 13, 38, 706505), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:13:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:13:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:13:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:38 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:13:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:13:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:55.685352+00:00 (in 9.999385 seconds) notificationworker stdout | 2022-05-05 11:13:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:55 UTC)" (scheduled at 2022-05-05 11:13:45.685352+00:00) notificationworker stdout | 2022-05-05 11:13:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:13:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 45, 686514), True, datetime.datetime(2022, 5, 5, 11, 13, 45, 686514), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:13:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:13:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:13:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:13:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:13:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:13:46,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:16.265236+00:00 (in 29.999438 seconds) buildlogsarchiver stdout | 2022-05-05 11:13:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:14:16 UTC)" (scheduled at 2022-05-05 11:13:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:13:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 13, 46, 266300), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:13:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:13:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:13:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:14:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:13:47,517 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:13:47,517 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:49.523944+00:00 (in 2.006804 seconds) repositorygcworker stdout | 2022-05-05 11:13:47,517 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:18:47 UTC)" (scheduled at 2022-05-05 11:13:47.516588+00:00) repositorygcworker stdout | 2022-05-05 11:13:47,518 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 13, 47, 517676), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:13:47,528 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 13, 47, 517676), True, datetime.datetime(2022, 5, 5, 11, 13, 47, 517676), 0, 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:13:47,531 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 13, 47, 517676), True, datetime.datetime(2022, 5, 5, 11, 13, 47, 517676), 0, 'repositorygc/%', False, datetime.datetime(2022, 5, 5, 11, 13, 47, 517676), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:13:47,532 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:13:47,532 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:18:47 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:13:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:13:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:13:51.436849+00:00 (in 1.912350 seconds) repositorygcworker stdout | 2022-05-05 11:13:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:49 UTC)" (scheduled at 2022-05-05 11:13:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:13:49,524 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:13:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:13:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:13:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:49.523944+00:00 (in 58.086491 seconds) repositorygcworker stdout | 2022-05-05 11:13:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:51 UTC)" (scheduled at 2022-05-05 11:13:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:13:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:13:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 51, 438147), True, datetime.datetime(2022, 5, 5, 11, 13, 51, 438147), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:13:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:13:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:13:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:14:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:13:53,220 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:13:53,448 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:13:53,524 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:13:53,530 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:13:53,564 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:13:53,615 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:13:53,620 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:13:53,654 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:13:53,685 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:13:53,741 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:13:53,783 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:13:53,821 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:13:53,862 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} expiredappspecifictokenworker stdout | 2022-05-05 11:13:53,873 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:13:53,913 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:13:53,970 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:13:53,978 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:13:54,133 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:13:54,197 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:13:54,569 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:13:54,588 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:13:54,600 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:13:54,617 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:13:54,623 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:13:54,651 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:13:54,660 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:13:54,666 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:13:54,673 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:13:54,678 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:13:54,690 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:13:54,696 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:13:54,703 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:13:54,708 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:13:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:13:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:05.685352+00:00 (in 9.999324 seconds) notificationworker stdout | 2022-05-05 11:13:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:05 UTC)" (scheduled at 2022-05-05 11:13:55.685352+00:00) notificationworker stdout | 2022-05-05 11:13:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:13:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 13, 55, 686684), True, datetime.datetime(2022, 5, 5, 11, 13, 55, 686684), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:13:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:13:55,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:13:55,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:13:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:13:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:28.857216+00:00 (in 29.999403 seconds) gcworker stdout | 2022-05-05 11:13:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:14:28 UTC)" (scheduled at 2022-05-05 11:13:58.857216+00:00) gcworker stdout | 2022-05-05 11:13:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539638858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:13:58,873 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:13:58,873 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:13:58,873 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:14:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:14:00,423 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:14:00,442 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:14:00,454 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:14:00,461 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:14:00,518 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:14:00,531 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:14:00,536 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:14:00,544 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:14:00,557 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:14:00,565 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:14:00,572 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:14:00,577 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:14:00,582 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:14:00,588 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:14:00,593 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:14:00,599 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:14:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:14:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:15.685352+00:00 (in 9.999226 seconds) notificationworker stdout | 2022-05-05 11:14:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:15 UTC)" (scheduled at 2022-05-05 11:14:05.685352+00:00) notificationworker stdout | 2022-05-05 11:14:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:14:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 5, 686697), True, datetime.datetime(2022, 5, 5, 11, 14, 5, 686697), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:14:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:14:05,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:14:05,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:14:07,938 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} namespacegcworker stdout | 2022-05-05 11:14:09,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:14:09,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:32.794430+00:00 (in 22.999608 seconds) namespacegcworker stdout | 2022-05-05 11:14:09,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:19:09 UTC)" (scheduled at 2022-05-05 11:14:09.794132+00:00) namespacegcworker stdout | 2022-05-05 11:14:09,796 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 14, 9, 795434), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:14:09,807 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 14, 9, 795434), True, datetime.datetime(2022, 5, 5, 11, 14, 9, 795434), 0, 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:14:09,809 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 14, 9, 795434), True, datetime.datetime(2022, 5, 5, 11, 14, 9, 795434), 0, 'namespacegc/%', False, datetime.datetime(2022, 5, 5, 11, 14, 9, 795434), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:14:09,810 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:14:09,810 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:19:09 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:14:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:14:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:25.685352+00:00 (in 9.999416 seconds) notificationworker stdout | 2022-05-05 11:14:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:25 UTC)" (scheduled at 2022-05-05 11:14:15.685352+00:00) notificationworker stdout | 2022-05-05 11:14:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:14:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 15, 686477), True, datetime.datetime(2022, 5, 5, 11, 14, 15, 686477), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:14:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:14:15,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:14:15,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:14:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:14:16,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:46.265236+00:00 (in 29.999454 seconds) buildlogsarchiver stdout | 2022-05-05 11:14:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:14:46 UTC)" (scheduled at 2022-05-05 11:14:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:14:16,266 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 14, 16, 266281), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:14:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:14:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:14:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:14:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:14:23,245 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:14:23,486 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:14:23,541 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:14:23,547 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:14:23,603 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:14:23,650 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:14:23,658 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:14:23,695 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:14:23,723 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:14:23,782 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:14:23,823 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:14:23,856 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:14:23,902 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} expiredappspecifictokenworker stdout | 2022-05-05 11:14:23,909 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:14:23,946 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:14:24,001 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:14:24,016 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:14:24,159 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:14:24,237 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:14:24,584 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:14:24,600 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:14:24,610 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:14:24,627 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:14:24,634 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:14:24,663 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:14:24,672 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:14:24,677 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:14:24,684 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:14:24,691 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:14:24,702 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:14:24,707 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:14:24,712 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:14:24,719 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:14:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:14:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:26.930811+00:00 (in 1.958726 seconds) exportactionlogsworker stdout | 2022-05-05 11:14:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:24 UTC)" (scheduled at 2022-05-05 11:14:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:14:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:14:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:14:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:14:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:32.784864+00:00 (in 7.098851 seconds) notificationworker stdout | 2022-05-05 11:14:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:35 UTC)" (scheduled at 2022-05-05 11:14:25.685352+00:00) notificationworker stdout | 2022-05-05 11:14:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:14:25,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 25, 686842), True, datetime.datetime(2022, 5, 5, 11, 14, 25, 686842), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:14:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:14:25,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:14:25,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:14:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:14:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:24.971405+00:00 (in 58.039888 seconds) exportactionlogsworker stdout | 2022-05-05 11:14:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:26 UTC)" (scheduled at 2022-05-05 11:14:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:14:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:14:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 26, 932114), True, datetime.datetime(2022, 5, 5, 11, 14, 26, 932114), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:14:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:14:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:14:26,943 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:14:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:14:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:58.857216+00:00 (in 29.999304 seconds) gcworker stdout | 2022-05-05 11:14:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:14:58 UTC)" (scheduled at 2022-05-05 11:14:28.857216+00:00) gcworker stdout | 2022-05-05 11:14:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539668858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:14:28,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:14:28,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:14:28,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:14:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:14:30,436 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:14:30,454 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:14:30,465 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:14:30,477 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:14:30,535 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:14:30,547 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:14:30,552 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:14:30,557 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:14:30,570 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:14:30,579 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:14:30,584 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:14:30,591 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:14:30,598 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:14:30,604 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:14:30,610 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:14:30,619 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:14:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:14:32,786 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:35.685352+00:00 (in 2.899631 seconds) notificationworker stdout | 2022-05-05 11:14:32,786 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:32 UTC)" (scheduled at 2022-05-05 11:14:32.784864+00:00) notificationworker stdout | 2022-05-05 11:14:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:14:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:14:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:14:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:38.705240+00:00 (in 5.910211 seconds) namespacegcworker stdout | 2022-05-05 11:14:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:32 UTC)" (scheduled at 2022-05-05 11:14:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:14:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:14:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:14:35,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:14:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:45.685352+00:00 (in 9.999164 seconds) notificationworker stdout | 2022-05-05 11:14:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:45 UTC)" (scheduled at 2022-05-05 11:14:35.685352+00:00) notificationworker stdout | 2022-05-05 11:14:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:14:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 35, 686762), True, datetime.datetime(2022, 5, 5, 11, 14, 35, 686762), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:14:35,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:14:35,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:14:35,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:14:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:14:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:32.794430+00:00 (in 54.088544 seconds) namespacegcworker stdout | 2022-05-05 11:14:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:38 UTC)" (scheduled at 2022-05-05 11:14:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:14:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:14:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 38, 706445), True, datetime.datetime(2022, 5, 5, 11, 14, 38, 706445), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:14:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:14:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:14:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:14:40,623 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:14:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:14:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:55.685352+00:00 (in 9.999382 seconds) notificationworker stdout | 2022-05-05 11:14:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:55 UTC)" (scheduled at 2022-05-05 11:14:45.685352+00:00) notificationworker stdout | 2022-05-05 11:14:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:14:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 45, 686507), True, datetime.datetime(2022, 5, 5, 11, 14, 45, 686507), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:14:45,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:14:45,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:14:45,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:14:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:14:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:14:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:16.265236+00:00 (in 29.999311 seconds) buildlogsarchiver stdout | 2022-05-05 11:14:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:15:16 UTC)" (scheduled at 2022-05-05 11:14:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:14:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 14, 46, 266430), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:14:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:14:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:14:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:15:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:14:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:14:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:14:51.436849+00:00 (in 1.912261 seconds) repositorygcworker stdout | 2022-05-05 11:14:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:49 UTC)" (scheduled at 2022-05-05 11:14:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:14:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:14:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:14:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:14:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:49.523944+00:00 (in 58.086525 seconds) repositorygcworker stdout | 2022-05-05 11:14:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:51 UTC)" (scheduled at 2022-05-05 11:14:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:14:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:14:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 51, 437983), True, datetime.datetime(2022, 5, 5, 11, 14, 51, 437983), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:14:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:14:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:14:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:15:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:14:53,276 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:14:53,529 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:14:53,577 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:14:53,586 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:14:53,622 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:14:53,684 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:14:53,699 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:14:53,734 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:14:53,739 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:14:53,814 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:14:53,856 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:14:53,878 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:14:53,921 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} expiredappspecifictokenworker stdout | 2022-05-05 11:14:53,926 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} globalpromstats stdout | 2022-05-05 11:14:53,987 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:14:54,037 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:14:54,054 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:14:54,170 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:14:54,278 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:14:54,599 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:14:54,611 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:14:54,621 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:14:54,638 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:14:54,644 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:14:54,674 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:14:54,686 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:14:54,694 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:14:54,701 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:14:54,707 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:14:54,713 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:14:54,722 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:14:54,729 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:14:54,734 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:14:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:14:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:05.685352+00:00 (in 9.999368 seconds) notificationworker stdout | 2022-05-05 11:14:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:05 UTC)" (scheduled at 2022-05-05 11:14:55.685352+00:00) notificationworker stdout | 2022-05-05 11:14:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:14:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 14, 55, 686550), True, datetime.datetime(2022, 5, 5, 11, 14, 55, 686550), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:14:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:14:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:14:55,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:05 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/0a9324c3-4fd6-4084-9e2b-259956c6abd4?blockid=REDACTED&comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '4194304000' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '93cd05de-cc64-11ec-8f91-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:14:57,399 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:14:57,401 [246] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: quaystorageaccount2.blob.core.windows.net gcworker stdout | 2022-05-05 11:14:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:14:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:28.857216+00:00 (in 29.999341 seconds) gcworker stdout | 2022-05-05 11:14:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:15:28 UTC)" (scheduled at 2022-05-05 11:14:58.857216+00:00) gcworker stdout | 2022-05-05 11:14:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539698858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:14:58,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:14:58,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:14:58,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:15:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:15:00,449 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:15:00,465 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:15:00,476 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:15:00,489 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:15:00,550 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:15:00,561 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:15:00,567 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:15:00,572 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:15:00,582 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:15:00,594 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:15:00,599 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:15:00,606 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:15:00,612 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:15:00,617 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:15:00,624 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:15:00,631 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:15:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:15:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:15.685352+00:00 (in 9.999378 seconds) notificationworker stdout | 2022-05-05 11:15:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:15 UTC)" (scheduled at 2022-05-05 11:15:05.685352+00:00) notificationworker stdout | 2022-05-05 11:15:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:15:05,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 5, 686623), True, datetime.datetime(2022, 5, 5, 11, 15, 5, 686623), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:15:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:15:05,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:15:05,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:15:10,640 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:15:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:15:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:25.685352+00:00 (in 9.999429 seconds) notificationworker stdout | 2022-05-05 11:15:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:25 UTC)" (scheduled at 2022-05-05 11:15:15.685352+00:00) notificationworker stdout | 2022-05-05 11:15:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:15:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 15, 686466), True, datetime.datetime(2022, 5, 5, 11, 15, 15, 686466), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:15:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:15:15,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:15:15,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:15:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:15:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:46.265236+00:00 (in 29.999405 seconds) buildlogsarchiver stdout | 2022-05-05 11:15:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:15:46 UTC)" (scheduled at 2022-05-05 11:15:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:15:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 15, 16, 266322), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:15:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:15:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:15:16,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:15:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:15:23,317 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:15:23,544 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:15:23,618 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:15:23,626 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:15:23,663 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:15:23,718 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:15:23,725 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:15:23,774 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:15:23,779 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:15:23,856 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:15:23,896 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:15:23,919 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:15:23,962 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:15:23,968 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:15:24,030 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:15:24,078 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:15:24,093 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:15:24,200 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:15:24,319 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:15:24,610 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:15:24,621 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:15:24,634 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:15:24,649 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:15:24,655 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:15:24,686 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:15:24,700 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:15:24,707 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:15:24,712 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:15:24,717 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:15:24,726 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:15:24,732 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:15:24,739 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:15:24,744 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:15:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:15:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:26.930811+00:00 (in 1.958640 seconds) exportactionlogsworker stdout | 2022-05-05 11:15:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:24 UTC)" (scheduled at 2022-05-05 11:15:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:15:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:15:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:15:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:15:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:31.783119+00:00 (in 6.097186 seconds) notificationworker stdout | 2022-05-05 11:15:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:35 UTC)" (scheduled at 2022-05-05 11:15:25.685352+00:00) notificationworker stdout | 2022-05-05 11:15:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:15:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 25, 686511), True, datetime.datetime(2022, 5, 5, 11, 15, 25, 686511), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:15:25,702 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:15:25,702 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:15:25,703 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:15:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:15:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:24.970422+00:00 (in 58.039031 seconds) exportactionlogsworker stdout | 2022-05-05 11:15:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:26 UTC)" (scheduled at 2022-05-05 11:15:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:15:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:15:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 26, 932184), True, datetime.datetime(2022, 5, 5, 11, 15, 26, 932184), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:15:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:15:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:15:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:15:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:15:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:58.857216+00:00 (in 29.999304 seconds) gcworker stdout | 2022-05-05 11:15:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:15:58 UTC)" (scheduled at 2022-05-05 11:15:28.857216+00:00) gcworker stdout | 2022-05-05 11:15:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539728858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:15:28,870 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:15:28,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:15:28,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:15:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:15:30,463 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:15:30,478 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:15:30,487 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:15:30,501 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:15:30,566 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:15:30,574 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:15:30,583 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:15:30,590 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:15:30,595 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:15:30,604 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:15:30,609 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:15:30,620 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:15:30,625 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:15:30,630 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:15:30,639 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:15:30,644 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:15:31,783 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:15:31,783 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:32.784864+00:00 (in 1.001149 seconds) notificationworker stdout | 2022-05-05 11:15:31,784 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:20:31 UTC)" (scheduled at 2022-05-05 11:15:31.783119+00:00) notificationworker stdout | 2022-05-05 11:15:31,785 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 15, 31, 784366), 'notification/%']) notificationworker stdout | 2022-05-05 11:15:31,795 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 15, 31, 784366), True, datetime.datetime(2022, 5, 5, 11, 15, 31, 784366), 0, 'notification/%']) notificationworker stdout | 2022-05-05 11:15:31,797 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 15, 31, 784366), True, datetime.datetime(2022, 5, 5, 11, 15, 31, 784366), 0, 'notification/%', False, datetime.datetime(2022, 5, 5, 11, 15, 31, 784366), 'notification/%']) notificationworker stdout | 2022-05-05 11:15:31,799 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:15:31,799 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:20:31 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:15:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:15:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:35.685352+00:00 (in 2.899776 seconds) notificationworker stdout | 2022-05-05 11:15:32,786 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:32 UTC)" (scheduled at 2022-05-05 11:15:32.784864+00:00) notificationworker stdout | 2022-05-05 11:15:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:15:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:15:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:15:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:38.705240+00:00 (in 5.910270 seconds) namespacegcworker stdout | 2022-05-05 11:15:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:32 UTC)" (scheduled at 2022-05-05 11:15:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:15:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:15:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:15:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:15:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:45.685352+00:00 (in 9.999239 seconds) notificationworker stdout | 2022-05-05 11:15:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:45 UTC)" (scheduled at 2022-05-05 11:15:35.685352+00:00) notificationworker stdout | 2022-05-05 11:15:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:15:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 35, 686703), True, datetime.datetime(2022, 5, 5, 11, 15, 35, 686703), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:15:35,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:15:35,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:15:35,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:15:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:15:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:32.794430+00:00 (in 54.088636 seconds) namespacegcworker stdout | 2022-05-05 11:15:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:38 UTC)" (scheduled at 2022-05-05 11:15:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:15:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:15:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 38, 706409), True, datetime.datetime(2022, 5, 5, 11, 15, 38, 706409), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:15:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:15:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:15:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:15:40,659 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:15:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:15:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:55.685352+00:00 (in 9.999217 seconds) notificationworker stdout | 2022-05-05 11:15:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:55 UTC)" (scheduled at 2022-05-05 11:15:45.685352+00:00) notificationworker stdout | 2022-05-05 11:15:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:15:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 45, 686812), True, datetime.datetime(2022, 5, 5, 11, 15, 45, 686812), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:15:45,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:15:45,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:15:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:15:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:15:46,266 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:15:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:16.265236+00:00 (in 29.998790 seconds) buildlogsarchiver stdout | 2022-05-05 11:15:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:16:16 UTC)" (scheduled at 2022-05-05 11:15:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:15:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 15, 46, 266951), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:15:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:15:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:15:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:16:16 UTC)" executed successfully nginx stdout | 2022/05/05 11:15:46 [error] 111#0: *82 upstream timed out (110: Connection timed out) while sending request to upstream, client: 93.136.90.201, server: , request: "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/0a9324c3-4fd6-4084-9e2b-259956c6abd4 HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_registry.sock/v2/ibazulic/test-big-layers/blobs/uploads/0a9324c3-4fd6-4084-9e2b-259956c6abd4", host: "20.67.27.216" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:15:46 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/0a9324c3-4fd6-4084-9e2b-259956c6abd4 HTTP/1.1" 504 183 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (731.669 4195509609 731.538) gunicorn-registry stdout | 2022-05-05 11:15:49,000 [246] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/0a9324c3-4fd6-4084-9e2b-259956c6abd4?blockid=MDAwMDA%3D&comp=block HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:15:49,000 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '3dfa5f4b-c01e-0054-2271-6058c1000000' gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '93cd05de-cc64-11ec-8f91-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:15:49,001 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:15:48 GMT' repositorygcworker stdout | 2022-05-05 11:15:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:15:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:15:51.436849+00:00 (in 1.912320 seconds) repositorygcworker stdout | 2022-05-05 11:15:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:49 UTC)" (scheduled at 2022-05-05 11:15:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:15:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:15:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:49 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:15:51,406 [245] [DEBUG] [app] Starting request: urn:request:6736ed9a-4fce-434f-a2a9-8b808e53750b (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:15:51,406 [245] [DEBUG] [auth.basic] Attempt to process basic auth header gunicorn-registry stdout | 2022-05-05 11:15:51,407 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['ibazulic', 'ibazulic', 1, 0]) repositorygcworker stdout | 2022-05-05 11:15:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:15:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:49.523944+00:00 (in 58.086487 seconds) repositorygcworker stdout | 2022-05-05 11:15:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:51 UTC)" (scheduled at 2022-05-05 11:15:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:15:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:15:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 51, 438095), True, datetime.datetime(2022, 5, 5, 11, 15, 51, 438095), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:15:51,451 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:15:51,451 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:15:51,451 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:16:51 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:15:51,724 [245] [DEBUG] [auth.credentials] Successfully validated credentials for user ibazulic gunicorn-registry stdout | 2022-05-05 11:15:51,725 [245] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-registry stdout | 2022-05-05 11:15:51,725 [245] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:15:51,725 [245] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:15:51,725 [245] [DEBUG] [endpoints.v2.v2auth] Request audience: 20.67.27.216 gunicorn-registry stdout | 2022-05-05 11:15:51,725 [245] [DEBUG] [endpoints.v2.v2auth] Scope request: ['repository:ibazulic/test-big-layers:push,pull'] gunicorn-registry stdout | 2022-05-05 11:15:51,726 [245] [DEBUG] [endpoints.v2.v2auth] Match: ('ibazulic/test-big-layers', 'ibazulic/test-big-layers', 'push,pull') gunicorn-registry stdout | 2022-05-05 11:15:51,727 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:15:51,730 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:15:51,731 [245] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:15:51,731 [245] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:15:51,731 [245] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:15:51,731 [245] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:15:51,732 [245] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-registry stdout | 2022-05-05 11:15:51,732 [245] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:15:51,740 [245] [DEBUG] [app] Ending request: urn:request:6736ed9a-4fce-434f-a2a9-8b808e53750b (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:15:51,741 [245] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:15:51,741 [245] [DEBUG] [peewee.pool] Returning 140025700772288 to pool. gunicorn-registry stdout | 2022-05-05 11:15:51,741 [245] [INFO] [gunicorn.access] 93.136.90.201 - ibazulic [05/May/2022:11:15:51 +0000] "GET /v2/auth?account=ibazulic&scope=repository%3Aibazulic%2Ftest-big-layers%3Apush%2Cpull&service=20.67.27.216 HTTP/1.1" 200 1033 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - ibazulic [05/May/2022:11:15:51 +0000] "GET /v2/auth?account=ibazulic&scope=repository%3Aibazulic%2Ftest-big-layers%3Apush%2Cpull&service=20.67.27.216 HTTP/1.1" 200 1033 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.336 385 0.336) gunicorn-registry stdout | 2022-05-05 11:15:51,742 [245] [DEBUG] [data.userevent] Published user event docker-cli: {'action': 'push_start', 'namespace': 'ibazulic', 'repository': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:15:51,809 [246] [DEBUG] [app] Starting request: urn:request:44bf3a27-629c-48ef-bce2-e7eccee76d5e (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:15:51,810 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:15:51,810 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ5MzUxLCJpYXQiOjE2NTE3NDkzNTEsImV4cCI6MTY1MTc1Mjk1MSwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.envf1J58kE_7JOQLkXeRYYnAL2os2I8tFbIPKragwqdSSggZ9N1SCutorf5j6OSbvfXA_qD0V_SiJ3uiv2v393h03KGRqlZfBxZGWJ9xjqxmy-nSk7AJRMAvdpDvm7xUpzs-u1gGWiA8bD3QOoEmh17yqEn9HujOGUzIqRWk1OMWZt7jY_8n5Xvjvdf5GH-5gTYhwRb8bIHNrjqOyruvcDH3Z1bJNUqYMzfCMsJnE7Hx20kBTCr_PtTRwznyhy7EA6WjjEdAv-Ffl72Pr55uYX8sOErHyRwdeEHBLaCrlp88pho45hAAqToCIpAaqvO12ejm_PKkJ8b0pC726GkNLQ gunicorn-registry stdout | 2022-05-05 11:15:51,810 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ5MzUxLCJpYXQiOjE2NTE3NDkzNTEsImV4cCI6MTY1MTc1Mjk1MSwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.envf1J58kE_7JOQLkXeRYYnAL2os2I8tFbIPKragwqdSSggZ9N1SCutorf5j6OSbvfXA_qD0V_SiJ3uiv2v393h03KGRqlZfBxZGWJ9xjqxmy-nSk7AJRMAvdpDvm7xUpzs-u1gGWiA8bD3QOoEmh17yqEn9HujOGUzIqRWk1OMWZt7jY_8n5Xvjvdf5GH-5gTYhwRb8bIHNrjqOyruvcDH3Z1bJNUqYMzfCMsJnE7Hx20kBTCr_PtTRwznyhy7EA6WjjEdAv-Ffl72Pr55uYX8sOErHyRwdeEHBLaCrlp88pho45hAAqToCIpAaqvO12ejm_PKkJ8b0pC726GkNLQ gunicorn-registry stdout | 2022-05-05 11:15:51,811 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:15:51,811 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:15:51,811 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:15:51,811 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:15:51,811 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:15:51,813 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:15:51,816 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:15:51,817 [246] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, '2dab1298-e85a-4bc9-80fb-6eeccf999406', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2022, 5, 5, 11, 15, 51, 817422)]) gunicorn-registry stdout | 2022-05-05 11:15:51,822 [246] [DEBUG] [app] Ending request: urn:request:44bf3a27-629c-48ef-bce2-e7eccee76d5e (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:15:51,822 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:15:51,822 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:15:51,823 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:15:51 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:15:51 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.015 1339 0.008) gunicorn-registry stdout | 2022-05-05 11:15:51,889 [231] [DEBUG] [app] Starting request: urn:request:c83ee7e8-0d8b-489e-86fe-a5234329bf12 (/v2/ibazulic/test-big-layers/blobs/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406) gunicorn-registry stdout | 2022-05-05 11:15:51,889 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '2dab1298-e85a-4bc9-80fb-6eeccf999406', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:15:51,889 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ5MzUxLCJpYXQiOjE2NTE3NDkzNTEsImV4cCI6MTY1MTc1Mjk1MSwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.envf1J58kE_7JOQLkXeRYYnAL2os2I8tFbIPKragwqdSSggZ9N1SCutorf5j6OSbvfXA_qD0V_SiJ3uiv2v393h03KGRqlZfBxZGWJ9xjqxmy-nSk7AJRMAvdpDvm7xUpzs-u1gGWiA8bD3QOoEmh17yqEn9HujOGUzIqRWk1OMWZt7jY_8n5Xvjvdf5GH-5gTYhwRb8bIHNrjqOyruvcDH3Z1bJNUqYMzfCMsJnE7Hx20kBTCr_PtTRwznyhy7EA6WjjEdAv-Ffl72Pr55uYX8sOErHyRwdeEHBLaCrlp88pho45hAAqToCIpAaqvO12ejm_PKkJ8b0pC726GkNLQ gunicorn-registry stdout | 2022-05-05 11:15:51,889 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzQ5MzUxLCJpYXQiOjE2NTE3NDkzNTEsImV4cCI6MTY1MTc1Mjk1MSwic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.envf1J58kE_7JOQLkXeRYYnAL2os2I8tFbIPKragwqdSSggZ9N1SCutorf5j6OSbvfXA_qD0V_SiJ3uiv2v393h03KGRqlZfBxZGWJ9xjqxmy-nSk7AJRMAvdpDvm7xUpzs-u1gGWiA8bD3QOoEmh17yqEn9HujOGUzIqRWk1OMWZt7jY_8n5Xvjvdf5GH-5gTYhwRb8bIHNrjqOyruvcDH3Z1bJNUqYMzfCMsJnE7Hx20kBTCr_PtTRwznyhy7EA6WjjEdAv-Ffl72Pr55uYX8sOErHyRwdeEHBLaCrlp88pho45hAAqToCIpAaqvO12ejm_PKkJ8b0pC726GkNLQ gunicorn-registry stdout | 2022-05-05 11:15:51,890 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:15:51,891 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:15:51,891 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:15:51,891 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:15:51,891 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:15:51,892 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:15:51,894 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['2dab1298-e85a-4bc9-80fb-6eeccf999406', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:15:51,896 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:15:51,896 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. logrotateworker stdout | 2022-05-05 11:15:53,347 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:15:53,584 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:15:53,644 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:15:53,658 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:15:53,702 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:15:53,745 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:15:53,761 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:15:53,805 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:15:53,817 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:15:53,886 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:15:53,916 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:15:53,931 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:15:54,002 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:15:54,008 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:15:54,069 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:15:54,108 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:15:54,130 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:15:54,243 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:15:54,360 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:15:54,622 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:15:54,631 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:15:54,644 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:15:54,658 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:15:54,665 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:15:54,698 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:15:54,719 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:15:54,726 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:15:54,732 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:15:54,737 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:15:54,742 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:15:54,748 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:15:54,754 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:15:54,759 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:15:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:15:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:05.685352+00:00 (in 9.999318 seconds) notificationworker stdout | 2022-05-05 11:15:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:05 UTC)" (scheduled at 2022-05-05 11:15:55.685352+00:00) notificationworker stdout | 2022-05-05 11:15:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:15:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 15, 55, 686563), True, datetime.datetime(2022, 5, 5, 11, 15, 55, 686563), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:15:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:15:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:15:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:15:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:15:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:28.857216+00:00 (in 29.999379 seconds) gcworker stdout | 2022-05-05 11:15:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:16:28 UTC)" (scheduled at 2022-05-05 11:15:58.857216+00:00) gcworker stdout | 2022-05-05 11:15:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539758858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:15:58,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:15:58,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:15:58,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:16:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:16:00,481 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:16:00,490 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:16:00,497 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:16:00,512 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:16:00,577 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:16:00,586 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:16:00,600 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:16:00,606 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:16:00,611 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:16:00,617 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:16:00,622 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:16:00,631 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:16:00,636 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:16:00,650 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:16:00,657 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:16:00,663 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:16:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:16:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:15.685352+00:00 (in 9.999427 seconds) notificationworker stdout | 2022-05-05 11:16:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:15 UTC)" (scheduled at 2022-05-05 11:16:05.685352+00:00) notificationworker stdout | 2022-05-05 11:16:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:16:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 5, 686476), True, datetime.datetime(2022, 5, 5, 11, 16, 5, 686476), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:16:05,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:16:05,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:16:05,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:16:10,673 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:16:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:16:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:25.685352+00:00 (in 9.999408 seconds) notificationworker stdout | 2022-05-05 11:16:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:25 UTC)" (scheduled at 2022-05-05 11:16:15.685352+00:00) notificationworker stdout | 2022-05-05 11:16:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:16:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 15, 686477), True, datetime.datetime(2022, 5, 5, 11, 16, 15, 686477), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:16:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:16:15,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:16:15,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:16:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:16:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:46.265236+00:00 (in 29.999422 seconds) buildlogsarchiver stdout | 2022-05-05 11:16:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:16:46 UTC)" (scheduled at 2022-05-05 11:16:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:16:16,266 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 16, 16, 266328), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:16:16,289 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:16:16,289 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:16:16,289 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:16:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:16:23,388 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:16:23,624 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:16:23,673 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:16:23,680 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:16:23,743 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:16:23,786 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:16:23,800 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:16:23,843 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:16:23,852 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:16:23,923 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:16:23,941 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:16:23,952 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:16:24,018 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:16:24,046 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:16:24,105 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:16:24,148 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:16:24,169 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:16:24,262 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:16:24,395 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:16:24,634 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:16:24,642 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:16:24,655 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:16:24,670 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:16:24,676 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:16:24,712 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:16:24,731 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:16:24,737 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:16:24,745 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:16:24,753 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:16:24,759 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:16:24,766 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:16:24,772 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:16:24,778 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:16:24,970 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:16:24,971 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:24.971405+00:00 (in 0.000357 seconds) exportactionlogsworker stdout | 2022-05-05 11:16:24,971 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:21:24 UTC)" (scheduled at 2022-05-05 11:16:24.970422+00:00) exportactionlogsworker stdout | 2022-05-05 11:16:24,972 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 16, 24, 971619), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:16:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:16:24,973 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:26.930811+00:00 (in 1.957321 seconds) exportactionlogsworker stdout | 2022-05-05 11:16:24,973 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:24 UTC)" (scheduled at 2022-05-05 11:16:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:16:24,973 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:16:24,974 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:24 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:16:24,983 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 16, 24, 971619), True, datetime.datetime(2022, 5, 5, 11, 16, 24, 971619), 0, 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:16:24,985 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 16, 24, 971619), True, datetime.datetime(2022, 5, 5, 11, 16, 24, 971619), 0, 'exportactionlogs/%', False, datetime.datetime(2022, 5, 5, 11, 16, 24, 971619), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:16:24,986 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:16:24,988 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:21:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:16:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:16:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:32.784864+00:00 (in 7.098862 seconds) notificationworker stdout | 2022-05-05 11:16:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:35 UTC)" (scheduled at 2022-05-05 11:16:25.685352+00:00) notificationworker stdout | 2022-05-05 11:16:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:16:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 25, 686622), True, datetime.datetime(2022, 5, 5, 11, 16, 25, 686622), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:16:25,705 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:16:25,706 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:16:25,706 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:16:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:16:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:24.971405+00:00 (in 58.040062 seconds) exportactionlogsworker stdout | 2022-05-05 11:16:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:26 UTC)" (scheduled at 2022-05-05 11:16:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:16:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:16:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 26, 932209), True, datetime.datetime(2022, 5, 5, 11, 16, 26, 932209), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:16:26,944 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:16:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:16:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:16:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:16:28,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:58.857216+00:00 (in 29.999446 seconds) gcworker stdout | 2022-05-05 11:16:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:16:58 UTC)" (scheduled at 2022-05-05 11:16:28.857216+00:00) gcworker stdout | 2022-05-05 11:16:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539788858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:16:28,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:16:28,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:16:28,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:16:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:16:30,501 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:16:30,507 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:16:30,513 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:16:30,523 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:16:30,591 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:16:30,599 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:16:30,617 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:16:30,622 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:16:30,630 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:16:30,635 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:16:30,640 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:16:30,646 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:16:30,652 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:16:30,662 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:16:30,668 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:16:30,673 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:16:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:16:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:35.685352+00:00 (in 2.899930 seconds) notificationworker stdout | 2022-05-05 11:16:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:32 UTC)" (scheduled at 2022-05-05 11:16:32.784864+00:00) notificationworker stdout | 2022-05-05 11:16:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:16:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:16:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:16:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:38.705240+00:00 (in 5.910215 seconds) namespacegcworker stdout | 2022-05-05 11:16:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:32 UTC)" (scheduled at 2022-05-05 11:16:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:16:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:16:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:16:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:16:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:45.685352+00:00 (in 9.999443 seconds) notificationworker stdout | 2022-05-05 11:16:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:45 UTC)" (scheduled at 2022-05-05 11:16:35.685352+00:00) notificationworker stdout | 2022-05-05 11:16:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:16:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 35, 687040), True, datetime.datetime(2022, 5, 5, 11, 16, 35, 687040), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:16:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:16:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:16:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:16:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:16:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:32.794430+00:00 (in 54.088542 seconds) namespacegcworker stdout | 2022-05-05 11:16:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:38 UTC)" (scheduled at 2022-05-05 11:16:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:16:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:16:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 38, 706430), True, datetime.datetime(2022, 5, 5, 11, 16, 38, 706430), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:16:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:16:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:16:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:16:40,685 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:16:45,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:16:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:55.685352+00:00 (in 9.999062 seconds) notificationworker stdout | 2022-05-05 11:16:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:55 UTC)" (scheduled at 2022-05-05 11:16:45.685352+00:00) notificationworker stdout | 2022-05-05 11:16:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:16:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 45, 686810), True, datetime.datetime(2022, 5, 5, 11, 16, 45, 686810), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:16:45,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:16:45,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:16:45,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:16:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:16:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:16:46,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:16.265236+00:00 (in 29.999429 seconds) buildlogsarchiver stdout | 2022-05-05 11:16:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:17:16 UTC)" (scheduled at 2022-05-05 11:16:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:16:46,266 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 16, 46, 266305), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:16:46,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:16:46,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:16:46,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:17:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:16:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:16:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:16:51.436849+00:00 (in 1.912369 seconds) repositorygcworker stdout | 2022-05-05 11:16:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:49 UTC)" (scheduled at 2022-05-05 11:16:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:16:49,524 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:16:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:16:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:16:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:49.523944+00:00 (in 58.086534 seconds) repositorygcworker stdout | 2022-05-05 11:16:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:51 UTC)" (scheduled at 2022-05-05 11:16:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:16:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:16:51,438 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 51, 437931), True, datetime.datetime(2022, 5, 5, 11, 16, 51, 437931), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:16:51,450 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:16:51,451 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:16:51,451 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:17:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:16:53,429 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:16:53,664 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:16:53,713 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:16:53,719 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:16:53,779 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:16:53,828 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:16:53,834 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:16:53,870 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:16:53,884 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:16:53,942 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:16:53,982 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:16:53,989 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:16:54,053 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:16:54,091 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:16:54,137 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:16:54,179 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:16:54,196 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:16:54,306 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:16:54,431 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:16:54,646 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:16:54,653 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:16:54,668 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:16:54,683 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:16:54,688 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:16:54,724 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:16:54,743 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:16:54,749 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:16:54,767 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:16:54,773 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:16:54,778 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:16:54,785 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:16:54,792 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:16:54,796 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:16:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:16:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:05.685352+00:00 (in 9.999461 seconds) notificationworker stdout | 2022-05-05 11:16:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:05 UTC)" (scheduled at 2022-05-05 11:16:55.685352+00:00) notificationworker stdout | 2022-05-05 11:16:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:16:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 16, 55, 686449), True, datetime.datetime(2022, 5, 5, 11, 16, 55, 686449), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:16:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:16:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:16:55,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:16:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:16:58,859 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:28.857216+00:00 (in 29.999377 seconds) gcworker stdout | 2022-05-05 11:16:58,859 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:17:28 UTC)" (scheduled at 2022-05-05 11:16:58.857216+00:00) gcworker stdout | 2022-05-05 11:16:58,861 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539818860, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:16:58,883 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:16:58,883 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:16:58,883 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:17:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:17:00,515 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:17:00,521 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:17:00,526 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:17:00,532 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:17:00,603 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:17:00,615 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:17:00,631 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:17:00,637 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:17:00,644 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:17:00,649 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:17:00,655 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:17:00,660 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:17:00,666 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:17:00,673 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:17:00,678 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:17:00,688 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:17:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:17:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:15.685352+00:00 (in 9.999391 seconds) notificationworker stdout | 2022-05-05 11:17:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:15 UTC)" (scheduled at 2022-05-05 11:17:05.685352+00:00) notificationworker stdout | 2022-05-05 11:17:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:17:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 5, 686549), True, datetime.datetime(2022, 5, 5, 11, 17, 5, 686549), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:17:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:17:05,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:17:05,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:17:10,699 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:17:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:17:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:25.685352+00:00 (in 9.999429 seconds) notificationworker stdout | 2022-05-05 11:17:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:25 UTC)" (scheduled at 2022-05-05 11:17:15.685352+00:00) notificationworker stdout | 2022-05-05 11:17:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:17:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 15, 686458), True, datetime.datetime(2022, 5, 5, 11, 17, 15, 686458), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:17:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:17:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:17:15,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:17:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:17:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:46.265236+00:00 (in 29.999321 seconds) buildlogsarchiver stdout | 2022-05-05 11:17:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:17:46 UTC)" (scheduled at 2022-05-05 11:17:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:17:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 17, 16, 266565), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:17:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:17:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:17:16,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:17:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:17:23,451 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:17:23,702 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:17:23,750 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:17:23,756 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:17:23,807 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:17:23,867 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:17:23,874 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:17:23,901 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:17:23,908 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:17:23,982 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:17:24,022 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:17:24,028 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:17:24,071 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:17:24,131 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:17:24,172 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:17:24,221 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:17:24,239 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:17:24,318 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:17:24,469 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:17:24,660 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:17:24,666 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:17:24,680 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:17:24,697 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:17:24,707 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:17:24,735 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:17:24,757 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:17:24,764 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:17:24,779 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:17:24,786 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:17:24,793 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:17:24,798 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:17:24,806 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:17:24,811 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:17:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:17:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:26.930811+00:00 (in 1.958797 seconds) exportactionlogsworker stdout | 2022-05-05 11:17:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:24 UTC)" (scheduled at 2022-05-05 11:17:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:17:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:17:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:17:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:17:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:32.784864+00:00 (in 7.098976 seconds) notificationworker stdout | 2022-05-05 11:17:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:35 UTC)" (scheduled at 2022-05-05 11:17:25.685352+00:00) notificationworker stdout | 2022-05-05 11:17:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:17:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 25, 686480), True, datetime.datetime(2022, 5, 5, 11, 17, 25, 686480), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:17:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:17:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:17:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:17:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:17:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:24.971405+00:00 (in 58.040015 seconds) exportactionlogsworker stdout | 2022-05-05 11:17:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:26 UTC)" (scheduled at 2022-05-05 11:17:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:17:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:17:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 26, 931968), True, datetime.datetime(2022, 5, 5, 11, 17, 26, 931968), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:17:26,946 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:17:26,946 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:17:26,946 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:17:28,859 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:17:28,859 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:58.857216+00:00 (in 29.997890 seconds) gcworker stdout | 2022-05-05 11:17:28,859 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:17:58 UTC)" (scheduled at 2022-05-05 11:17:28.857216+00:00) gcworker stdout | 2022-05-05 11:17:28,860 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539848859, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:17:28,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:17:28,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:17:28,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:17:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:17:30,533 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:17:30,548 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:17:30,549 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:17:30,553 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:17:30,616 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:17:30,627 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:17:30,645 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:17:30,652 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:17:30,657 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:17:30,662 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:17:30,671 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:17:30,677 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:17:30,682 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:17:30,689 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:17:30,693 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:17:30,702 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:17:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:17:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:35.685352+00:00 (in 2.899935 seconds) notificationworker stdout | 2022-05-05 11:17:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:32 UTC)" (scheduled at 2022-05-05 11:17:32.784864+00:00) notificationworker stdout | 2022-05-05 11:17:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:17:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:17:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:17:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:38.705240+00:00 (in 5.910277 seconds) namespacegcworker stdout | 2022-05-05 11:17:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:32 UTC)" (scheduled at 2022-05-05 11:17:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:17:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:17:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:17:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:17:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:45.685352+00:00 (in 9.999412 seconds) notificationworker stdout | 2022-05-05 11:17:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:45 UTC)" (scheduled at 2022-05-05 11:17:35.685352+00:00) notificationworker stdout | 2022-05-05 11:17:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:17:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 35, 686481), True, datetime.datetime(2022, 5, 5, 11, 17, 35, 686481), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:17:35,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:17:35,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:17:35,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:17:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:17:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:32.794430+00:00 (in 54.088580 seconds) namespacegcworker stdout | 2022-05-05 11:17:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:38 UTC)" (scheduled at 2022-05-05 11:17:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:17:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:17:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 38, 706376), True, datetime.datetime(2022, 5, 5, 11, 17, 38, 706376), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:17:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:17:38,718 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:17:38,718 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:17:40,718 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:17:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:17:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:55.685352+00:00 (in 9.999412 seconds) notificationworker stdout | 2022-05-05 11:17:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:55 UTC)" (scheduled at 2022-05-05 11:17:45.685352+00:00) notificationworker stdout | 2022-05-05 11:17:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:17:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 45, 686493), True, datetime.datetime(2022, 5, 5, 11, 17, 45, 686493), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:17:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:17:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:17:45,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:17:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:17:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:17:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:16.265236+00:00 (in 29.999275 seconds) buildlogsarchiver stdout | 2022-05-05 11:17:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:18:16 UTC)" (scheduled at 2022-05-05 11:17:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:17:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 17, 46, 266482), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:17:46,279 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:17:46,279 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:17:46,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:18:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:17:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:17:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:17:51.436849+00:00 (in 1.912277 seconds) repositorygcworker stdout | 2022-05-05 11:17:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:49 UTC)" (scheduled at 2022-05-05 11:17:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:17:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:17:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:17:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:17:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:47.516588+00:00 (in 56.079038 seconds) repositorygcworker stdout | 2022-05-05 11:17:51,438 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:51 UTC)" (scheduled at 2022-05-05 11:17:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:17:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:17:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 51, 438205), True, datetime.datetime(2022, 5, 5, 11, 17, 51, 438205), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:17:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:17:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:17:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:18:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:17:53,474 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:17:53,742 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:17:53,774 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:17:53,779 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:17:53,848 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:17:53,911 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:17:53,918 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:17:53,946 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:17:53,951 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:17:54,020 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:17:54,059 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:17:54,065 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:17:54,111 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:17:54,170 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:17:54,211 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:17:54,258 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gcworker stdout | 2022-05-05 11:17:54,276 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} servicekey stdout | 2022-05-05 11:17:54,358 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:17:54,509 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:17:54,673 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:17:54,682 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:17:54,693 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:17:54,709 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:17:54,716 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:17:54,748 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:17:54,771 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:17:54,776 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:17:54,789 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:17:54,799 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:17:54,804 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:17:54,809 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:17:54,815 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:17:54,822 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:17:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:17:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:05.685352+00:00 (in 9.999439 seconds) notificationworker stdout | 2022-05-05 11:17:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:05 UTC)" (scheduled at 2022-05-05 11:17:55.685352+00:00) notificationworker stdout | 2022-05-05 11:17:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:17:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 17, 55, 686459), True, datetime.datetime(2022, 5, 5, 11, 17, 55, 686459), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:17:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:17:55,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:17:55,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:05 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:17:55,996 [228] [DEBUG] [app] Starting request: urn:request:0094c656-e92f-4ab4-92d5-bec4486014a0 (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:17:55,996 [229] [DEBUG] [app] Starting request: urn:request:fca72098-19e0-460f-bc7b-72c555a4e8f1 (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:17:55,996 [228] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:17:55,996 [229] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:17:55,996 [229] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:17:55,997 [229] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:17:55,996 [228] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:17:55,997 [228] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:17:55,998 [228] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:17:55,998 [229] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:17:56,007 [228] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:17:56,008 [228] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:17:56,008 [228] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:17:56,008 [228] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:17:56,008 [228] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:17:56,008 [228] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:17:56,008 [228] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:17:56,008 [228] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:17:56,008 [229] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:17:56,008 [228] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:17:56,009 [229] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2022, 5, 8, 6, 29, 56, 8854), datetime.datetime(2022, 5, 5, 11, 17, 56, 8956)]) gunicorn-web stdout | 2022-05-05 11:17:56,011 [229] [DEBUG] [app] Ending request: urn:request:fca72098-19e0-460f-bc7b-72c555a4e8f1 (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:17:56,012 [228] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6]) gunicorn-web stdout | 2022-05-05 11:17:56,012 [229] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:17:56,013 [229] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:17:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:17:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.021 979 0.024) gunicorn-web stdout | 2022-05-05 11:17:56,018 [228] [DEBUG] [app] Ending request: urn:request:0094c656-e92f-4ab4-92d5-bec4486014a0 (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:17:56,019 [228] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:17:56 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.025 970 0.024) gunicorn-web stdout | 2022-05-05 11:17:56,019 [228] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:17:56 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gcworker stdout | 2022-05-05 11:17:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:17:58,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:28.857216+00:00 (in 29.999435 seconds) gcworker stdout | 2022-05-05 11:17:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:18:28 UTC)" (scheduled at 2022-05-05 11:17:58.857216+00:00) gcworker stdout | 2022-05-05 11:17:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539878858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:17:58,870 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:17:58,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:17:58,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:18:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:18:00,548 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:18:00,561 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:18:00,570 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:18:00,577 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:18:00,627 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:18:00,640 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:18:00,659 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:18:00,664 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:18:00,673 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:18:00,680 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:18:00,686 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:18:00,691 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:18:00,696 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:18:00,702 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:18:00,707 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:18:00,716 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:18:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:18:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:15.685352+00:00 (in 9.999396 seconds) notificationworker stdout | 2022-05-05 11:18:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:15 UTC)" (scheduled at 2022-05-05 11:18:05.685352+00:00) notificationworker stdout | 2022-05-05 11:18:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:18:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 5, 686615), True, datetime.datetime(2022, 5, 5, 11, 18, 5, 686615), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:18:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:18:05,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:18:05,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:18:10,734 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:18:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:18:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:25.685352+00:00 (in 9.999310 seconds) notificationworker stdout | 2022-05-05 11:18:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:25 UTC)" (scheduled at 2022-05-05 11:18:15.685352+00:00) notificationworker stdout | 2022-05-05 11:18:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:18:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 15, 686612), True, datetime.datetime(2022, 5, 5, 11, 18, 15, 686612), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:18:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:18:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:18:15,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:18:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:18:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:46.265236+00:00 (in 29.999406 seconds) buildlogsarchiver stdout | 2022-05-05 11:18:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:18:46 UTC)" (scheduled at 2022-05-05 11:18:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:18:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 18, 16, 266527), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:18:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:18:16,279 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:18:16,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:18:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:18:23,515 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:18:23,782 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:18:23,806 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:18:23,816 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:18:23,872 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:18:23,926 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:18:23,958 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:18:23,987 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:18:23,992 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:18:24,061 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:18:24,098 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:18:24,103 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:18:24,150 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:18:24,207 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:18:24,243 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:18:24,289 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:18:24,296 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:18:24,396 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:18:24,528 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:18:24,684 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:18:24,694 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:18:24,703 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:18:24,720 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:18:24,729 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:18:24,761 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:18:24,782 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:18:24,788 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:18:24,802 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:18:24,810 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:18:24,816 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:18:24,822 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:18:24,828 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:18:24,832 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:18:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:18:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:26.930811+00:00 (in 1.958780 seconds) exportactionlogsworker stdout | 2022-05-05 11:18:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:24 UTC)" (scheduled at 2022-05-05 11:18:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:18:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:18:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:18:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:18:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:32.784864+00:00 (in 7.098955 seconds) notificationworker stdout | 2022-05-05 11:18:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:35 UTC)" (scheduled at 2022-05-05 11:18:25.685352+00:00) notificationworker stdout | 2022-05-05 11:18:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:18:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 25, 686455), True, datetime.datetime(2022, 5, 5, 11, 18, 25, 686455), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:18:25,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:18:25,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:18:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:18:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:18:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:24.971405+00:00 (in 58.039991 seconds) exportactionlogsworker stdout | 2022-05-05 11:18:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:26 UTC)" (scheduled at 2022-05-05 11:18:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:18:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:18:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 26, 931990), True, datetime.datetime(2022, 5, 5, 11, 18, 26, 931990), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:18:26,944 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:18:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:18:26,945 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:18:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:18:28,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:58.857216+00:00 (in 29.999422 seconds) gcworker stdout | 2022-05-05 11:18:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:18:58 UTC)" (scheduled at 2022-05-05 11:18:28.857216+00:00) gcworker stdout | 2022-05-05 11:18:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539908858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:18:28,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:18:28,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:18:28,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:18:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:18:30,561 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:18:30,572 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:18:30,582 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:18:30,589 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:18:30,641 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:18:30,654 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:18:30,675 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:18:30,681 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:18:30,693 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:18:30,699 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:18:30,705 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:18:30,711 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:18:30,716 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:18:30,722 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:18:30,727 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:18:30,733 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:18:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:18:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:35.685352+00:00 (in 2.899879 seconds) notificationworker stdout | 2022-05-05 11:18:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:32 UTC)" (scheduled at 2022-05-05 11:18:32.784864+00:00) notificationworker stdout | 2022-05-05 11:18:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:18:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:18:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:18:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:38.705240+00:00 (in 5.910244 seconds) namespacegcworker stdout | 2022-05-05 11:18:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:32 UTC)" (scheduled at 2022-05-05 11:18:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:18:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:18:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:18:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:18:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:45.685352+00:00 (in 9.999312 seconds) notificationworker stdout | 2022-05-05 11:18:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:45 UTC)" (scheduled at 2022-05-05 11:18:35.685352+00:00) notificationworker stdout | 2022-05-05 11:18:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:18:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 35, 686624), True, datetime.datetime(2022, 5, 5, 11, 18, 35, 686624), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:18:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:18:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:18:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:18:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:18:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:09.794132+00:00 (in 31.088262 seconds) namespacegcworker stdout | 2022-05-05 11:18:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:38 UTC)" (scheduled at 2022-05-05 11:18:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:18:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:18:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 38, 706457), True, datetime.datetime(2022, 5, 5, 11, 18, 38, 706457), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:18:38,725 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:18:38,725 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:18:38,725 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:18:40,751 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:18:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:18:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:55.685352+00:00 (in 9.999439 seconds) notificationworker stdout | 2022-05-05 11:18:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:55 UTC)" (scheduled at 2022-05-05 11:18:45.685352+00:00) notificationworker stdout | 2022-05-05 11:18:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:18:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 45, 686499), True, datetime.datetime(2022, 5, 5, 11, 18, 45, 686499), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:18:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:18:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:18:45,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:18:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:18:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:18:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:16.265236+00:00 (in 29.999386 seconds) buildlogsarchiver stdout | 2022-05-05 11:18:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:19:16 UTC)" (scheduled at 2022-05-05 11:18:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:18:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 18, 46, 266380), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:18:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:18:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:18:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:19:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:18:47,517 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:18:47,517 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:49.523944+00:00 (in 2.006729 seconds) repositorygcworker stdout | 2022-05-05 11:18:47,517 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:23:47 UTC)" (scheduled at 2022-05-05 11:18:47.516588+00:00) repositorygcworker stdout | 2022-05-05 11:18:47,518 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 18, 47, 517709), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:18:47,528 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 18, 47, 517709), True, datetime.datetime(2022, 5, 5, 11, 18, 47, 517709), 0, 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:18:47,531 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 18, 47, 517709), True, datetime.datetime(2022, 5, 5, 11, 18, 47, 517709), 0, 'repositorygc/%', False, datetime.datetime(2022, 5, 5, 11, 18, 47, 517709), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:18:47,532 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:18:47,532 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:23:47 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:18:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:18:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:18:51.436849+00:00 (in 1.912354 seconds) repositorygcworker stdout | 2022-05-05 11:18:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:49 UTC)" (scheduled at 2022-05-05 11:18:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:18:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:18:49,526 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:18:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:18:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:49.523944+00:00 (in 58.086415 seconds) repositorygcworker stdout | 2022-05-05 11:18:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:51 UTC)" (scheduled at 2022-05-05 11:18:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:18:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:18:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 51, 438247), True, datetime.datetime(2022, 5, 5, 11, 18, 51, 438247), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:18:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:18:51,450 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:18:51,450 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:19:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:18:53,551 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:18:53,822 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:18:53,846 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:18:53,851 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:18:53,912 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:18:53,966 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:18:53,996 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:18:54,030 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:18:54,036 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:18:54,098 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:18:54,141 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:18:54,147 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:18:54,177 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:18:54,247 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:18:54,281 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:18:54,327 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:18:54,333 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:18:54,434 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:18:54,568 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:18:54,696 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:18:54,704 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:18:54,715 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:18:54,732 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:18:54,739 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:18:54,775 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:18:54,796 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:18:54,802 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:18:54,813 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:18:54,824 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:18:54,830 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:18:54,839 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:18:54,843 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:18:54,848 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:18:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:18:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:05.685352+00:00 (in 9.999458 seconds) notificationworker stdout | 2022-05-05 11:18:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:05 UTC)" (scheduled at 2022-05-05 11:18:55.685352+00:00) notificationworker stdout | 2022-05-05 11:18:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:18:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 18, 55, 686321), True, datetime.datetime(2022, 5, 5, 11, 18, 55, 686321), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:18:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:18:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:18:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:18:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:18:58,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:28.857216+00:00 (in 29.999416 seconds) gcworker stdout | 2022-05-05 11:18:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:19:28 UTC)" (scheduled at 2022-05-05 11:18:58.857216+00:00) gcworker stdout | 2022-05-05 11:18:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539938858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:18:58,873 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:18:58,873 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:18:58,873 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:19:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:19:00,579 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:19:00,585 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:19:00,594 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:19:00,604 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:19:00,654 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:19:00,668 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:19:00,689 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:19:00,694 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:19:00,704 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:19:00,713 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:19:00,724 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:19:00,730 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:19:00,736 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:19:00,743 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:19:00,749 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:19:00,755 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:19:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:19:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:15.685352+00:00 (in 9.999311 seconds) notificationworker stdout | 2022-05-05 11:19:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:15 UTC)" (scheduled at 2022-05-05 11:19:05.685352+00:00) notificationworker stdout | 2022-05-05 11:19:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:19:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 5, 686581), True, datetime.datetime(2022, 5, 5, 11, 19, 5, 686581), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:19:05,705 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:19:05,705 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:19:05,705 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:15 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:19:09,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:19:09,794 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:32.794430+00:00 (in 22.999722 seconds) namespacegcworker stdout | 2022-05-05 11:19:09,800 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:24:09 UTC)" (scheduled at 2022-05-05 11:19:09.794132+00:00) namespacegcworker stdout | 2022-05-05 11:19:09,800 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 19, 9, 800254), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:19:09,810 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 19, 9, 800254), True, datetime.datetime(2022, 5, 5, 11, 19, 9, 800254), 0, 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:19:09,812 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 19, 9, 800254), True, datetime.datetime(2022, 5, 5, 11, 19, 9, 800254), 0, 'namespacegc/%', False, datetime.datetime(2022, 5, 5, 11, 19, 9, 800254), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:19:09,813 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:19:09,814 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:24:09 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:19:10,766 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:19:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:19:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:25.685352+00:00 (in 9.999308 seconds) notificationworker stdout | 2022-05-05 11:19:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:25 UTC)" (scheduled at 2022-05-05 11:19:15.685352+00:00) notificationworker stdout | 2022-05-05 11:19:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:19:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 15, 686651), True, datetime.datetime(2022, 5, 5, 11, 19, 15, 686651), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:19:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:19:15,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:19:15,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:19:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:19:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:46.265236+00:00 (in 29.999384 seconds) buildlogsarchiver stdout | 2022-05-05 11:19:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:19:46 UTC)" (scheduled at 2022-05-05 11:19:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:19:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 19, 16, 266255), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:19:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:19:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:19:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:19:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:19:23,592 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:19:23,833 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:19:23,871 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} blobuploadcleanupworker stdout | 2022-05-05 11:19:23,877 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} builder stdout | 2022-05-05 11:19:23,932 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:19:23,984 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:19:24,034 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:19:24,067 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:19:24,077 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:19:24,141 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:19:24,178 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:19:24,184 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:19:24,195 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:19:24,288 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} globalpromstats stdout | 2022-05-05 11:19:24,323 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gcworker stdout | 2022-05-05 11:19:24,345 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:19:24,370 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:19:24,446 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:19:24,609 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:19:24,711 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:19:24,717 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:19:24,725 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:19:24,744 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:19:24,756 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:19:24,787 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:19:24,809 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:19:24,814 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:19:24,823 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:19:24,837 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:19:24,842 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:19:24,851 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:19:24,858 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:19:24,863 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:19:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:19:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:26.930811+00:00 (in 1.958839 seconds) exportactionlogsworker stdout | 2022-05-05 11:19:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:24 UTC)" (scheduled at 2022-05-05 11:19:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:19:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:19:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:19:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:19:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:32.784864+00:00 (in 7.098918 seconds) notificationworker stdout | 2022-05-05 11:19:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:35 UTC)" (scheduled at 2022-05-05 11:19:25.685352+00:00) notificationworker stdout | 2022-05-05 11:19:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:19:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 25, 686490), True, datetime.datetime(2022, 5, 5, 11, 19, 25, 686490), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:19:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:19:25,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:19:25,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:19:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:19:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:24.971405+00:00 (in 58.039921 seconds) exportactionlogsworker stdout | 2022-05-05 11:19:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:26 UTC)" (scheduled at 2022-05-05 11:19:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:19:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:19:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 26, 932190), True, datetime.datetime(2022, 5, 5, 11, 19, 26, 932190), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:19:26,944 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:19:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:19:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:19:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:19:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:58.857216+00:00 (in 29.999352 seconds) gcworker stdout | 2022-05-05 11:19:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:19:58 UTC)" (scheduled at 2022-05-05 11:19:28.857216+00:00) gcworker stdout | 2022-05-05 11:19:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539968858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:19:28,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:19:28,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:19:28,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:19:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:19:30,592 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:19:30,600 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:19:30,606 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:19:30,616 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:19:30,671 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:19:30,704 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:19:30,709 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:19:30,717 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:19:30,726 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:19:30,748 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:19:30,762 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:19:30,769 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:19:30,775 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:19:30,781 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:19:30,786 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:19:31,240 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:19:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:19:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:35.685352+00:00 (in 2.899928 seconds) notificationworker stdout | 2022-05-05 11:19:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:32 UTC)" (scheduled at 2022-05-05 11:19:32.784864+00:00) notificationworker stdout | 2022-05-05 11:19:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:19:32,785 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:19:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:19:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:38.705240+00:00 (in 5.910282 seconds) namespacegcworker stdout | 2022-05-05 11:19:32,796 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:32 UTC)" (scheduled at 2022-05-05 11:19:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:19:32,796 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:19:32,796 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:19:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:19:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:45.685352+00:00 (in 9.999455 seconds) notificationworker stdout | 2022-05-05 11:19:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:45 UTC)" (scheduled at 2022-05-05 11:19:35.685352+00:00) notificationworker stdout | 2022-05-05 11:19:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:19:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 35, 686421), True, datetime.datetime(2022, 5, 5, 11, 19, 35, 686421), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:19:35,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:19:35,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:19:35,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:19:38,706 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:19:38,707 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:32.794430+00:00 (in 54.087536 seconds) namespacegcworker stdout | 2022-05-05 11:19:38,707 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:38 UTC)" (scheduled at 2022-05-05 11:19:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:19:38,707 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:19:38,708 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 38, 707342), True, datetime.datetime(2022, 5, 5, 11, 19, 38, 707342), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:19:38,718 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:19:38,718 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:19:38,718 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:19:40,781 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:19:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:19:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:55.685352+00:00 (in 9.999403 seconds) notificationworker stdout | 2022-05-05 11:19:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:55 UTC)" (scheduled at 2022-05-05 11:19:45.685352+00:00) notificationworker stdout | 2022-05-05 11:19:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:19:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 45, 686495), True, datetime.datetime(2022, 5, 5, 11, 19, 45, 686495), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:19:45,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:19:45,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:19:45,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:19:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:19:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:19:46,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:16.265236+00:00 (in 29.999456 seconds) buildlogsarchiver stdout | 2022-05-05 11:19:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:20:16 UTC)" (scheduled at 2022-05-05 11:19:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:19:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 19, 46, 266338), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:19:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:19:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:19:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:20:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:19:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:19:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:19:51.436849+00:00 (in 1.912303 seconds) repositorygcworker stdout | 2022-05-05 11:19:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:49 UTC)" (scheduled at 2022-05-05 11:19:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:19:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:19:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:19:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:19:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:49.523944+00:00 (in 58.086476 seconds) repositorygcworker stdout | 2022-05-05 11:19:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:51 UTC)" (scheduled at 2022-05-05 11:19:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:19:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:19:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 51, 438012), True, datetime.datetime(2022, 5, 5, 11, 19, 51, 438012), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:19:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:19:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:19:51,450 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:20:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:19:53,636 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:19:53,869 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:19:53,894 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:19:53,908 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:19:53,973 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:19:54,024 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:19:54,074 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:19:54,110 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:19:54,117 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:19:54,180 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:19:54,218 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:19:54,227 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:19:54,232 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:19:54,330 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:19:54,357 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:19:54,364 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:19:54,411 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:19:54,459 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:19:54,653 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:19:54,729 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:19:54,739 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:19:54,744 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:19:54,757 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:19:54,770 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:19:54,801 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:19:54,827 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:19:54,832 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:19:54,839 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:19:54,848 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:19:54,854 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:19:54,863 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:19:54,872 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:19:54,878 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:19:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:19:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:05.685352+00:00 (in 9.999399 seconds) notificationworker stdout | 2022-05-05 11:19:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:05 UTC)" (scheduled at 2022-05-05 11:19:55.685352+00:00) notificationworker stdout | 2022-05-05 11:19:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:19:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 19, 55, 686515), True, datetime.datetime(2022, 5, 5, 11, 19, 55, 686515), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:19:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:19:55,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:19:55,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:19:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:19:58,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:28.857216+00:00 (in 29.999436 seconds) gcworker stdout | 2022-05-05 11:19:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:20:28 UTC)" (scheduled at 2022-05-05 11:19:58.857216+00:00) gcworker stdout | 2022-05-05 11:19:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650539998858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:19:58,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:19:58,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:19:58,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:20:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:20:00,604 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:20:00,612 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:20:00,617 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:20:00,626 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:20:00,686 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:20:00,725 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:20:00,731 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:20:00,737 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:20:00,743 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:20:00,759 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:20:00,775 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:20:00,783 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:20:00,792 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:20:00,801 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:20:00,807 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:20:01,255 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:20:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:20:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:15.685352+00:00 (in 9.999432 seconds) notificationworker stdout | 2022-05-05 11:20:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:15 UTC)" (scheduled at 2022-05-05 11:20:05.685352+00:00) notificationworker stdout | 2022-05-05 11:20:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:20:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 5, 686456), True, datetime.datetime(2022, 5, 5, 11, 20, 5, 686456), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:20:05,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:20:05,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:20:05,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:20:10,797 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:20:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:20:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:25.685352+00:00 (in 9.999467 seconds) notificationworker stdout | 2022-05-05 11:20:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:25 UTC)" (scheduled at 2022-05-05 11:20:15.685352+00:00) notificationworker stdout | 2022-05-05 11:20:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:20:15,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 15, 686562), True, datetime.datetime(2022, 5, 5, 11, 20, 15, 686562), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:20:15,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:20:15,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:20:15,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:20:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:20:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:46.265236+00:00 (in 29.999425 seconds) buildlogsarchiver stdout | 2022-05-05 11:20:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:20:46 UTC)" (scheduled at 2022-05-05 11:20:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:20:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 20, 16, 266310), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:20:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:20:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:20:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:20:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:20:23,674 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:20:23,907 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:20:23,914 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:20:23,947 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:20:24,005 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:20:24,064 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:20:24,099 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:20:24,147 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:20:24,152 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:20:24,218 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:20:24,253 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} namespacegcworker stdout | 2022-05-05 11:20:24,260 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:20:24,265 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} manifestbackfillworker stdout | 2022-05-05 11:20:24,370 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:20:24,395 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:20:24,405 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:20:24,447 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:20:24,502 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:20:24,694 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:20:24,742 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:20:24,751 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:20:24,758 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:20:24,769 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:20:24,781 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:20:24,817 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:20:24,840 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:20:24,849 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:20:24,854 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:20:24,860 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:20:24,865 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:20:24,874 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:20:24,884 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:20:24,890 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:20:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:20:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:26.930811+00:00 (in 1.958657 seconds) exportactionlogsworker stdout | 2022-05-05 11:20:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:24 UTC)" (scheduled at 2022-05-05 11:20:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:20:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:20:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:20:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:20:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:31.783119+00:00 (in 6.097216 seconds) notificationworker stdout | 2022-05-05 11:20:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:35 UTC)" (scheduled at 2022-05-05 11:20:25.685352+00:00) notificationworker stdout | 2022-05-05 11:20:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:20:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 25, 686490), True, datetime.datetime(2022, 5, 5, 11, 20, 25, 686490), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:20:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:20:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:20:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:20:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:20:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:24.970422+00:00 (in 58.038958 seconds) exportactionlogsworker stdout | 2022-05-05 11:20:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:26 UTC)" (scheduled at 2022-05-05 11:20:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:20:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:20:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 26, 932116), True, datetime.datetime(2022, 5, 5, 11, 20, 26, 932116), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:20:26,944 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:20:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:20:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:20:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:20:28,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:58.857216+00:00 (in 29.999457 seconds) gcworker stdout | 2022-05-05 11:20:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:20:58 UTC)" (scheduled at 2022-05-05 11:20:28.857216+00:00) gcworker stdout | 2022-05-05 11:20:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540028858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:20:28,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:20:28,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:20:28,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:20:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:20:30,620 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:20:30,627 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:20:30,633 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:20:30,638 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:20:30,701 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:20:30,743 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:20:30,750 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:20:30,755 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:20:30,760 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:20:30,772 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:20:30,793 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:20:30,798 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:20:30,806 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:20:30,814 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:20:30,820 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:20:31,268 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:20:31,783 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:20:31,784 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:32.784864+00:00 (in 1.001064 seconds) notificationworker stdout | 2022-05-05 11:20:31,784 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:25:31 UTC)" (scheduled at 2022-05-05 11:20:31.783119+00:00) notificationworker stdout | 2022-05-05 11:20:31,785 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 20, 31, 784335), 'notification/%']) notificationworker stdout | 2022-05-05 11:20:31,795 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 20, 31, 784335), True, datetime.datetime(2022, 5, 5, 11, 20, 31, 784335), 0, 'notification/%']) notificationworker stdout | 2022-05-05 11:20:31,797 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 20, 31, 784335), True, datetime.datetime(2022, 5, 5, 11, 20, 31, 784335), 0, 'notification/%', False, datetime.datetime(2022, 5, 5, 11, 20, 31, 784335), 'notification/%']) notificationworker stdout | 2022-05-05 11:20:31,798 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:20:31,798 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:25:31 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:20:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:20:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:35.685352+00:00 (in 2.899845 seconds) notificationworker stdout | 2022-05-05 11:20:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:32 UTC)" (scheduled at 2022-05-05 11:20:32.784864+00:00) notificationworker stdout | 2022-05-05 11:20:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:20:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:20:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:20:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:38.705240+00:00 (in 5.910222 seconds) namespacegcworker stdout | 2022-05-05 11:20:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:32 UTC)" (scheduled at 2022-05-05 11:20:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:20:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:20:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:20:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:20:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:45.685352+00:00 (in 9.999351 seconds) notificationworker stdout | 2022-05-05 11:20:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:45 UTC)" (scheduled at 2022-05-05 11:20:35.685352+00:00) notificationworker stdout | 2022-05-05 11:20:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:20:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 35, 686549), True, datetime.datetime(2022, 5, 5, 11, 20, 35, 686549), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:20:35,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:20:35,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:20:35,702 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:20:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:20:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:32.794430+00:00 (in 54.088626 seconds) namespacegcworker stdout | 2022-05-05 11:20:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:38 UTC)" (scheduled at 2022-05-05 11:20:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:20:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:20:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 38, 706358), True, datetime.datetime(2022, 5, 5, 11, 20, 38, 706358), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:20:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:20:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:20:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:20:40,814 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:20:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:20:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:55.685352+00:00 (in 9.999447 seconds) notificationworker stdout | 2022-05-05 11:20:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:55 UTC)" (scheduled at 2022-05-05 11:20:45.685352+00:00) notificationworker stdout | 2022-05-05 11:20:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:20:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 45, 686527), True, datetime.datetime(2022, 5, 5, 11, 20, 45, 686527), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:20:45,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:20:45,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:20:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:20:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:20:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:20:46,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:16.265236+00:00 (in 29.999445 seconds) buildlogsarchiver stdout | 2022-05-05 11:20:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:21:16 UTC)" (scheduled at 2022-05-05 11:20:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:20:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 20, 46, 266309), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:20:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:20:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:20:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:21:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:20:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:20:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:20:51.436849+00:00 (in 1.912326 seconds) repositorygcworker stdout | 2022-05-05 11:20:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:49 UTC)" (scheduled at 2022-05-05 11:20:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:20:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:20:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:20:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:20:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:49.523944+00:00 (in 58.086399 seconds) repositorygcworker stdout | 2022-05-05 11:20:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:51 UTC)" (scheduled at 2022-05-05 11:20:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:20:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:20:51,438 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 51, 438078), True, datetime.datetime(2022, 5, 5, 11, 20, 51, 438078), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:20:51,448 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:20:51,448 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:20:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:21:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:20:53,687 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:20:53,937 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:20:53,962 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:20:53,984 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:20:54,034 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:20:54,076 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:20:54,141 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:20:54,189 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:20:54,195 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:20:54,253 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:20:54,290 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:20:54,296 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} queuecleanupworker stdout | 2022-05-05 11:20:54,301 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} manifestbackfillworker stdout | 2022-05-05 11:20:54,389 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:20:54,426 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:20:54,432 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:20:54,489 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:20:54,529 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:20:54,732 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:20:54,753 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:20:54,764 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:20:54,769 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:20:54,779 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:20:54,793 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:20:54,829 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:20:54,853 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:20:54,859 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:20:54,864 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:20:54,870 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:20:54,876 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:20:54,887 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:20:54,896 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:20:54,901 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:20:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:20:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:05.685352+00:00 (in 9.999323 seconds) notificationworker stdout | 2022-05-05 11:20:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:05 UTC)" (scheduled at 2022-05-05 11:20:55.685352+00:00) notificationworker stdout | 2022-05-05 11:20:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:20:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 20, 55, 686673), True, datetime.datetime(2022, 5, 5, 11, 20, 55, 686673), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:20:55,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:20:55,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:20:55,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:20:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:20:58,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:28.857216+00:00 (in 29.999458 seconds) gcworker stdout | 2022-05-05 11:20:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:21:28 UTC)" (scheduled at 2022-05-05 11:20:58.857216+00:00) gcworker stdout | 2022-05-05 11:20:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540058858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:20:58,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:20:58,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:20:58,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:21:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:21:00,638 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:21:00,645 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:21:00,651 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:21:00,656 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:21:00,715 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:21:00,760 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:21:00,766 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:21:00,772 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:21:00,777 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:21:00,785 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:21:00,806 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:21:00,815 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:21:00,828 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:21:00,836 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:21:00,836 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:21:02,495 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:21:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:21:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:15.685352+00:00 (in 9.999318 seconds) notificationworker stdout | 2022-05-05 11:21:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:15 UTC)" (scheduled at 2022-05-05 11:21:05.685352+00:00) notificationworker stdout | 2022-05-05 11:21:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:21:05,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 5, 686645), True, datetime.datetime(2022, 5, 5, 11, 21, 5, 686645), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:21:05,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:21:05,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:21:05,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:21:10,834 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:21:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:21:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:25.685352+00:00 (in 9.999423 seconds) notificationworker stdout | 2022-05-05 11:21:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:25 UTC)" (scheduled at 2022-05-05 11:21:15.685352+00:00) notificationworker stdout | 2022-05-05 11:21:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:21:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 15, 686486), True, datetime.datetime(2022, 5, 5, 11, 21, 15, 686486), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:21:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:21:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:21:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:21:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:21:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:46.265236+00:00 (in 29.999393 seconds) buildlogsarchiver stdout | 2022-05-05 11:21:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:21:46 UTC)" (scheduled at 2022-05-05 11:21:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:21:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 21, 16, 266410), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:21:16,283 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:21:16,283 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:21:16,283 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:21:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:21:23,727 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:21:23,980 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:21:24,002 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:21:24,021 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:21:24,072 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:21:24,113 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:21:24,180 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:21:24,228 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:21:24,233 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:21:24,290 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:21:24,322 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:21:24,328 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:21:24,335 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:21:24,429 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:21:24,468 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:21:24,480 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:21:24,519 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:21:24,570 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:21:24,765 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} storagereplication stdout | 2022-05-05 11:21:24,772 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:21:24,780 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:21:24,786 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:21:24,791 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:21:24,802 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:21:24,844 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:21:24,865 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:21:24,872 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:21:24,877 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:21:24,883 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:21:24,892 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:21:24,897 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:21:24,906 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:21:24,911 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:21:24,970 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:21:24,971 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:24.971405+00:00 (in 0.000420 seconds) exportactionlogsworker stdout | 2022-05-05 11:21:24,971 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:26:24 UTC)" (scheduled at 2022-05-05 11:21:24.970422+00:00) exportactionlogsworker stdout | 2022-05-05 11:21:24,972 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 21, 24, 971539), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:21:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:21:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:26.930811+00:00 (in 1.958157 seconds) exportactionlogsworker stdout | 2022-05-05 11:21:24,973 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:24 UTC)" (scheduled at 2022-05-05 11:21:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:21:24,973 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:21:24,973 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:24 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:21:24,982 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 21, 24, 971539), True, datetime.datetime(2022, 5, 5, 11, 21, 24, 971539), 0, 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:21:24,984 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 21, 24, 971539), True, datetime.datetime(2022, 5, 5, 11, 21, 24, 971539), 0, 'exportactionlogs/%', False, datetime.datetime(2022, 5, 5, 11, 21, 24, 971539), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:21:24,985 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:21:24,985 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:26:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:21:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:21:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:32.784864+00:00 (in 7.098947 seconds) notificationworker stdout | 2022-05-05 11:21:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:35 UTC)" (scheduled at 2022-05-05 11:21:25.685352+00:00) notificationworker stdout | 2022-05-05 11:21:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:21:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 25, 686678), True, datetime.datetime(2022, 5, 5, 11, 21, 25, 686678), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:21:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:21:25,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:21:25,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:21:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:21:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:24.971405+00:00 (in 58.040111 seconds) exportactionlogsworker stdout | 2022-05-05 11:21:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:26 UTC)" (scheduled at 2022-05-05 11:21:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:21:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:21:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 26, 931755), True, datetime.datetime(2022, 5, 5, 11, 21, 26, 931755), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:21:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:21:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:21:26,943 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:21:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:21:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:58.857216+00:00 (in 29.999389 seconds) gcworker stdout | 2022-05-05 11:21:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:21:58 UTC)" (scheduled at 2022-05-05 11:21:28.857216+00:00) gcworker stdout | 2022-05-05 11:21:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540088858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:21:28,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:21:28,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:21:28,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:21:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:21:30,653 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:21:30,658 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:21:30,665 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:21:30,671 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:21:30,728 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:21:30,776 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:21:30,782 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:21:30,788 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:21:30,794 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:21:30,799 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:21:30,824 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:21:30,830 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:21:30,843 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:21:30,847 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:21:30,852 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:21:32,511 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:21:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:21:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:35.685352+00:00 (in 2.899572 seconds) notificationworker stdout | 2022-05-05 11:21:32,786 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:32 UTC)" (scheduled at 2022-05-05 11:21:32.784864+00:00) notificationworker stdout | 2022-05-05 11:21:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:21:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:21:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:21:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:38.705240+00:00 (in 5.910298 seconds) namespacegcworker stdout | 2022-05-05 11:21:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:32 UTC)" (scheduled at 2022-05-05 11:21:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:21:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:21:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:21:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:21:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:45.685352+00:00 (in 9.999334 seconds) notificationworker stdout | 2022-05-05 11:21:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:45 UTC)" (scheduled at 2022-05-05 11:21:35.685352+00:00) notificationworker stdout | 2022-05-05 11:21:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:21:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 35, 686571), True, datetime.datetime(2022, 5, 5, 11, 21, 35, 686571), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:21:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:21:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:21:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:21:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:21:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:32.794430+00:00 (in 54.088579 seconds) namespacegcworker stdout | 2022-05-05 11:21:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:38 UTC)" (scheduled at 2022-05-05 11:21:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:21:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:21:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 38, 706399), True, datetime.datetime(2022, 5, 5, 11, 21, 38, 706399), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:21:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:21:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:21:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:21:40,850 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:21:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:21:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:55.685352+00:00 (in 9.999378 seconds) notificationworker stdout | 2022-05-05 11:21:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:55 UTC)" (scheduled at 2022-05-05 11:21:45.685352+00:00) notificationworker stdout | 2022-05-05 11:21:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:21:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 45, 686575), True, datetime.datetime(2022, 5, 5, 11, 21, 45, 686575), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:21:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:21:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:21:45,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:21:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:21:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:21:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:16.265236+00:00 (in 29.999418 seconds) buildlogsarchiver stdout | 2022-05-05 11:21:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:22:16 UTC)" (scheduled at 2022-05-05 11:21:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:21:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 21, 46, 266400), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:21:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:21:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:21:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:22:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:21:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:21:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:21:51.436849+00:00 (in 1.912308 seconds) repositorygcworker stdout | 2022-05-05 11:21:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:49 UTC)" (scheduled at 2022-05-05 11:21:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:21:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:21:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:21:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:21:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:49.523944+00:00 (in 58.086433 seconds) repositorygcworker stdout | 2022-05-05 11:21:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:51 UTC)" (scheduled at 2022-05-05 11:21:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:21:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:21:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 51, 438061), True, datetime.datetime(2022, 5, 5, 11, 21, 51, 438061), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:21:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:21:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:21:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:22:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:21:53,775 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:21:54,018 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:21:54,033 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:21:54,058 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:21:54,110 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:21:54,152 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:21:54,225 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:21:54,266 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:21:54,273 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:21:54,329 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:21:54,362 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:21:54,367 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:21:54,372 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:21:54,466 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:21:54,502 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:21:54,527 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:21:54,559 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:21:54,609 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:21:54,777 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:21:54,790 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:21:54,801 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:21:54,808 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} storagereplication stdout | 2022-05-05 11:21:54,813 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-secscan stdout | 2022-05-05 11:21:54,820 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:21:54,860 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:21:54,877 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:21:54,885 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:21:54,907 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:21:54,914 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:21:54,921 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:21:54,927 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:21:54,934 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:21:54,941 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:21:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:21:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:05.685352+00:00 (in 9.999419 seconds) notificationworker stdout | 2022-05-05 11:21:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:05 UTC)" (scheduled at 2022-05-05 11:21:55.685352+00:00) notificationworker stdout | 2022-05-05 11:21:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:21:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 21, 55, 686476), True, datetime.datetime(2022, 5, 5, 11, 21, 55, 686476), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:21:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:21:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:21:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:21:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:21:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:28.857216+00:00 (in 29.999297 seconds) gcworker stdout | 2022-05-05 11:21:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:22:28 UTC)" (scheduled at 2022-05-05 11:21:58.857216+00:00) gcworker stdout | 2022-05-05 11:21:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540118858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:21:58,877 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:21:58,878 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:21:58,878 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:22:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:22:00,667 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:22:00,671 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:22:00,678 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:22:00,688 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:22:00,739 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:22:00,792 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:22:00,799 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:22:00,806 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:22:00,812 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:22:00,819 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:22:00,836 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:22:00,843 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:22:00,855 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:22:00,860 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:22:00,866 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:22:02,524 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:22:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:22:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:15.685352+00:00 (in 9.999436 seconds) notificationworker stdout | 2022-05-05 11:22:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:15 UTC)" (scheduled at 2022-05-05 11:22:05.685352+00:00) notificationworker stdout | 2022-05-05 11:22:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:22:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 5, 686437), True, datetime.datetime(2022, 5, 5, 11, 22, 5, 686437), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:22:05,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:22:05,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:22:05,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:22:10,866 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} globalpromstats stdout | 2022-05-05 11:22:13,431 [69] [DEBUG] [apscheduler.scheduler] Looking for jobs to run globalpromstats stdout | 2022-05-05 11:22:13,432 [69] [INFO] [apscheduler.executors.default] Running job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2022-05-05 11:22:13 UTC)" (scheduled at 2022-05-05 11:22:13.431348+00:00) globalpromstats stdout | 2022-05-05 11:22:13,432 [69] [DEBUG] [__main__] Attempting to report stats globalpromstats stdout | 2022-05-05 11:22:13,432 [69] [DEBUG] [util.locking] Acquiring global lock GLOBAL_PROM_STATS globalpromstats stdout | 2022-05-05 11:22:13,432 [69] [DEBUG] [util.locking] Acquired lock GLOBAL_PROM_STATS globalpromstats stdout | 2022-05-05 11:22:13,432 [69] [DEBUG] [__main__] Reporting global stats globalpromstats stdout | 2022-05-05 11:22:13,433 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "repository" AS "t1") AS "_wrapped"', []) globalpromstats stdout | 2022-05-05 11:22:13,434 [69] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 12:22:13.431348+00:00 (in 3599.999569 seconds) globalpromstats stdout | 2022-05-05 11:22:13,444 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."id" NOT IN (SELECT "t2"."namespace_id" FROM "deletednamespace" AS "t2")))) AS "_wrapped"', [False, False]) globalpromstats stdout | 2022-05-05 11:22:13,446 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "user" AS "t1" WHERE ((("t1"."organization" = %s) AND ("t1"."robot" = %s)) AND ("t1"."enabled" = %s))) AS "_wrapped"', [True, False, True]) globalpromstats stdout | 2022-05-05 11:22:13,447 [69] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT 1 FROM "robotaccounttoken" AS "t1") AS "_wrapped"', []) globalpromstats stdout | 2022-05-05 11:22:13,449 [69] [DEBUG] [data.database] Disconnecting from database. globalpromstats stdout | 2022-05-05 11:22:13,449 [69] [DEBUG] [util.locking] Releasing lock GLOBAL_PROM_STATS globalpromstats stdout | 2022-05-05 11:22:13,450 [69] [DEBUG] [util.locking] Released lock GLOBAL_PROM_STATS globalpromstats stdout | 2022-05-05 11:22:13,450 [69] [INFO] [apscheduler.executors.default] Job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2022-05-05 12:22:13 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:22:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:22:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:25.685352+00:00 (in 9.999471 seconds) notificationworker stdout | 2022-05-05 11:22:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:25 UTC)" (scheduled at 2022-05-05 11:22:15.685352+00:00) notificationworker stdout | 2022-05-05 11:22:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:22:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 15, 686474), True, datetime.datetime(2022, 5, 5, 11, 22, 15, 686474), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:22:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:22:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:22:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:22:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:22:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:46.265236+00:00 (in 29.999357 seconds) buildlogsarchiver stdout | 2022-05-05 11:22:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:22:46 UTC)" (scheduled at 2022-05-05 11:22:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:22:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 22, 16, 266470), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:22:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:22:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:22:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:22:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:22:23,816 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:22:24,059 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:22:24,070 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:22:24,093 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:22:24,143 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:22:24,182 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:22:24,262 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:22:24,282 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:22:24,306 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:22:24,369 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} namespacegcworker stdout | 2022-05-05 11:22:24,402 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:22:24,407 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:22:24,412 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:22:24,489 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:22:24,543 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:22:24,567 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:22:24,598 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:22:24,646 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:22:24,789 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:22:24,800 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:22:24,810 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:22:24,819 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:22:24,831 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} storagereplication stdout | 2022-05-05 11:22:24,854 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-web stdout | 2022-05-05 11:22:24,872 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:22:24,888 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:22:24,895 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:22:24,921 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:22:24,928 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:22:24,934 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:22:24,941 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:22:24,948 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:22:24,954 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} exportactionlogsworker stdout | 2022-05-05 11:22:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:22:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:26.930811+00:00 (in 1.958882 seconds) exportactionlogsworker stdout | 2022-05-05 11:22:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:24 UTC)" (scheduled at 2022-05-05 11:22:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:22:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:22:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:24 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:22:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:22:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:32.784864+00:00 (in 7.098851 seconds) notificationworker stdout | 2022-05-05 11:22:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:35 UTC)" (scheduled at 2022-05-05 11:22:25.685352+00:00) notificationworker stdout | 2022-05-05 11:22:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:22:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 25, 686470), True, datetime.datetime(2022, 5, 5, 11, 22, 25, 686470), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:22:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:22:25,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:22:25,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:22:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:22:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:24.971405+00:00 (in 58.040006 seconds) exportactionlogsworker stdout | 2022-05-05 11:22:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:26 UTC)" (scheduled at 2022-05-05 11:22:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:22:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:22:26,932 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 26, 931961), True, datetime.datetime(2022, 5, 5, 11, 22, 26, 931961), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:22:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:22:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:22:26,943 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:22:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:22:28,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:58.857216+00:00 (in 29.999419 seconds) gcworker stdout | 2022-05-05 11:22:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:22:58 UTC)" (scheduled at 2022-05-05 11:22:28.857216+00:00) gcworker stdout | 2022-05-05 11:22:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540148858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:22:28,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:22:28,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:22:28,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:22:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:22:30,681 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:22:30,688 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:22:30,693 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:22:30,700 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:22:30,752 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:22:30,808 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:22:30,814 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:22:30,824 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:22:30,831 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:22:30,837 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:22:30,847 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:22:30,853 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:22:30,865 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:22:30,872 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:22:30,878 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:22:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:22:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:35.685352+00:00 (in 2.899809 seconds) notificationworker stdout | 2022-05-05 11:22:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:32 UTC)" (scheduled at 2022-05-05 11:22:32.784864+00:00) notificationworker stdout | 2022-05-05 11:22:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:22:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:22:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:22:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:38.705240+00:00 (in 5.910256 seconds) namespacegcworker stdout | 2022-05-05 11:22:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:32 UTC)" (scheduled at 2022-05-05 11:22:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:22:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:22:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:32 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:22:33,996 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:22:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:22:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:45.685352+00:00 (in 9.999401 seconds) notificationworker stdout | 2022-05-05 11:22:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:45 UTC)" (scheduled at 2022-05-05 11:22:35.685352+00:00) notificationworker stdout | 2022-05-05 11:22:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:22:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 35, 686583), True, datetime.datetime(2022, 5, 5, 11, 22, 35, 686583), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:22:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:22:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:22:35,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:22:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:22:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:32.794430+00:00 (in 54.088648 seconds) namespacegcworker stdout | 2022-05-05 11:22:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:38 UTC)" (scheduled at 2022-05-05 11:22:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:22:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:22:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 38, 706193), True, datetime.datetime(2022, 5, 5, 11, 22, 38, 706193), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:22:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:22:38,718 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:22:38,718 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:22:40,885 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:22:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:22:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:55.685352+00:00 (in 9.999250 seconds) notificationworker stdout | 2022-05-05 11:22:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:55 UTC)" (scheduled at 2022-05-05 11:22:45.685352+00:00) notificationworker stdout | 2022-05-05 11:22:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:22:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 45, 687022), True, datetime.datetime(2022, 5, 5, 11, 22, 45, 687022), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:22:45,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:22:45,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:22:45,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:22:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:22:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:22:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:16.265236+00:00 (in 29.999417 seconds) buildlogsarchiver stdout | 2022-05-05 11:22:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:23:16 UTC)" (scheduled at 2022-05-05 11:22:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:22:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 22, 46, 266295), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:22:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:22:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:22:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:23:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:22:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:22:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:22:51.436849+00:00 (in 1.912353 seconds) repositorygcworker stdout | 2022-05-05 11:22:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:49 UTC)" (scheduled at 2022-05-05 11:22:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:22:49,524 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:22:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:22:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:22:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:47.516588+00:00 (in 56.079225 seconds) repositorygcworker stdout | 2022-05-05 11:22:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:51 UTC)" (scheduled at 2022-05-05 11:22:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:22:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:22:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 51, 437951), True, datetime.datetime(2022, 5, 5, 11, 22, 51, 437951), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:22:51,450 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:22:51,450 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:22:51,450 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:23:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:22:53,848 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:22:54,093 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:22:54,105 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:22:54,136 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:22:54,184 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:22:54,222 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:22:54,280 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:22:54,324 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:22:54,329 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:22:54,399 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:22:54,443 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} namespacegcworker stdout | 2022-05-05 11:22:54,449 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:22:54,456 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} manifestbackfillworker stdout | 2022-05-05 11:22:54,530 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:22:54,585 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:22:54,610 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:22:54,645 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:22:54,687 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:22:54,800 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:22:54,815 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:22:54,820 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:22:54,829 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:22:54,840 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:22:54,888 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} storagereplication stdout | 2022-05-05 11:22:54,893 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-web stdout | 2022-05-05 11:22:54,899 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:22:54,908 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:22:54,932 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:22:54,939 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:22:54,945 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:22:54,950 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:22:54,959 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:22:54,964 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:22:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:22:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:05.685352+00:00 (in 9.999216 seconds) notificationworker stdout | 2022-05-05 11:22:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:05 UTC)" (scheduled at 2022-05-05 11:22:55.685352+00:00) notificationworker stdout | 2022-05-05 11:22:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:22:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 22, 55, 687033), True, datetime.datetime(2022, 5, 5, 11, 22, 55, 687033), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:22:55,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:22:55,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:22:55,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:05 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:22:56,005 [222] [DEBUG] [app] Starting request: urn:request:eccf1234-67d4-4132-b2d8-7440305a13aa (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:22:56,005 [222] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:22:56,006 [222] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:22:56,006 [222] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:22:56,007 [222] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:22:56,007 [230] [DEBUG] [app] Starting request: urn:request:b8013c46-1f9d-4dde-a892-65a7d87a3619 (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:22:56,008 [230] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:22:56,008 [230] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:22:56,008 [230] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:22:56,009 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:22:56,021 [230] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:22:56,021 [222] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:22:56,022 [230] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2022, 5, 8, 6, 34, 56, 22186), datetime.datetime(2022, 5, 5, 11, 22, 56, 22300)]) gunicorn-web stdout | 2022-05-05 11:22:56,023 [222] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6]) gunicorn-web stdout | 2022-05-05 11:22:56,025 [230] [DEBUG] [app] Ending request: urn:request:b8013c46-1f9d-4dde-a892-65a7d87a3619 (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:22:56,026 [230] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:22:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.020 979 0.020) gunicorn-web stdout | 2022-05-05 11:22:56,027 [230] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:22:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gunicorn-web stdout | 2022-05-05 11:22:56,029 [222] [DEBUG] [app] Ending request: urn:request:eccf1234-67d4-4132-b2d8-7440305a13aa (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:22:56,030 [222] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:22:56 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.027 970 0.024) gunicorn-web stdout | 2022-05-05 11:22:56,031 [222] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:22:56 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gcworker stdout | 2022-05-05 11:22:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:22:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:28.857216+00:00 (in 29.998794 seconds) gcworker stdout | 2022-05-05 11:22:58,859 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:23:28 UTC)" (scheduled at 2022-05-05 11:22:58.857216+00:00) gcworker stdout | 2022-05-05 11:22:58,860 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540178859, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:22:58,873 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:22:58,873 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:22:58,873 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:23:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:23:00,695 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:23:00,708 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:23:00,712 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:23:00,721 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:23:00,767 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:23:00,821 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:23:00,826 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:23:00,838 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:23:00,848 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:23:00,854 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:23:00,861 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:23:00,867 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:23:00,875 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:23:00,884 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:23:00,891 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:23:04,013 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:23:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:23:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:15.685352+00:00 (in 9.999374 seconds) notificationworker stdout | 2022-05-05 11:23:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:15 UTC)" (scheduled at 2022-05-05 11:23:05.685352+00:00) notificationworker stdout | 2022-05-05 11:23:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:23:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 5, 686498), True, datetime.datetime(2022, 5, 5, 11, 23, 5, 686498), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:23:05,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:23:05,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:23:05,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:23:10,903 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:23:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:23:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:25.685352+00:00 (in 9.999395 seconds) notificationworker stdout | 2022-05-05 11:23:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:25 UTC)" (scheduled at 2022-05-05 11:23:15.685352+00:00) notificationworker stdout | 2022-05-05 11:23:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:23:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 15, 686514), True, datetime.datetime(2022, 5, 5, 11, 23, 15, 686514), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:23:15,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:23:15,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:23:15,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:23:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:23:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:46.265236+00:00 (in 29.999372 seconds) buildlogsarchiver stdout | 2022-05-05 11:23:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:23:46 UTC)" (scheduled at 2022-05-05 11:23:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:23:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 23, 16, 266523), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:23:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:23:16,279 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:23:16,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:23:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:23:23,882 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:23:24,128 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:23:24,141 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:23:24,179 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:23:24,221 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:23:24,263 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:23:24,318 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:23:24,356 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:23:24,369 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:23:24,442 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:23:24,484 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} namespacegcworker stdout | 2022-05-05 11:23:24,494 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} queuecleanupworker stdout | 2022-05-05 11:23:24,499 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} manifestbackfillworker stdout | 2022-05-05 11:23:24,563 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:23:24,625 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:23:24,651 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:23:24,679 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:23:24,728 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:23:24,812 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:23:24,829 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:23:24,841 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:23:24,841 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:23:24,849 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:23:24,903 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:23:24,909 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:23:24,920 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} storagereplication stdout | 2022-05-05 11:23:24,929 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-web stdout | 2022-05-05 11:23:24,951 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:23:24,961 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:23:24,968 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} exportactionlogsworker stdout | 2022-05-05 11:23:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:23:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:26.930811+00:00 (in 1.958790 seconds) exportactionlogsworker stdout | 2022-05-05 11:23:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:24 UTC)" (scheduled at 2022-05-05 11:23:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:23:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:23:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:24 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:23:24,974 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:23:24,979 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:23:24,984 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:23:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:23:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:32.784864+00:00 (in 7.098957 seconds) notificationworker stdout | 2022-05-05 11:23:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:35 UTC)" (scheduled at 2022-05-05 11:23:25.685352+00:00) notificationworker stdout | 2022-05-05 11:23:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:23:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 25, 686477), True, datetime.datetime(2022, 5, 5, 11, 23, 25, 686477), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:23:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:23:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:23:25,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:23:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:23:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:24.971405+00:00 (in 58.040040 seconds) exportactionlogsworker stdout | 2022-05-05 11:23:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:26 UTC)" (scheduled at 2022-05-05 11:23:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:23:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:23:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 26, 932056), True, datetime.datetime(2022, 5, 5, 11, 23, 26, 932056), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:23:26,945 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:23:26,945 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:23:26,945 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:23:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:23:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:58.857216+00:00 (in 29.999275 seconds) gcworker stdout | 2022-05-05 11:23:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:23:58 UTC)" (scheduled at 2022-05-05 11:23:28.857216+00:00) gcworker stdout | 2022-05-05 11:23:28,858 [68] [DEBUG] [peewee] ('SELECT DISTINCT "t1"."removed_tag_expiration_s" FROM "user" AS "t1" LIMIT %s', [100]) gcworker stdout | 2022-05-05 11:23:28,871 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540208870, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:23:28,874 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:23:28,874 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:23:28,875 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:23:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:23:30,708 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:23:30,719 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:23:30,727 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:23:30,733 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:23:30,783 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:23:30,835 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:23:30,840 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:23:30,849 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:23:30,862 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:23:30,868 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:23:30,874 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:23:30,882 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:23:30,887 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:23:30,900 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:23:30,906 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:23:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:23:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:35.685352+00:00 (in 2.899851 seconds) notificationworker stdout | 2022-05-05 11:23:32,786 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:32 UTC)" (scheduled at 2022-05-05 11:23:32.784864+00:00) notificationworker stdout | 2022-05-05 11:23:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:23:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:23:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:23:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:38.705240+00:00 (in 5.910299 seconds) namespacegcworker stdout | 2022-05-05 11:23:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:32 UTC)" (scheduled at 2022-05-05 11:23:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:23:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:23:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:32 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:23:34,027 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:23:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:23:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:45.685352+00:00 (in 9.999255 seconds) notificationworker stdout | 2022-05-05 11:23:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:45 UTC)" (scheduled at 2022-05-05 11:23:35.685352+00:00) notificationworker stdout | 2022-05-05 11:23:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:23:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 35, 686793), True, datetime.datetime(2022, 5, 5, 11, 23, 35, 686793), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:23:35,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:23:35,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:23:35,702 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:23:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:23:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:09.794132+00:00 (in 31.088327 seconds) namespacegcworker stdout | 2022-05-05 11:23:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:38 UTC)" (scheduled at 2022-05-05 11:23:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:23:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:23:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 38, 706333), True, datetime.datetime(2022, 5, 5, 11, 23, 38, 706333), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:23:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:23:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:23:38,718 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:23:40,918 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:23:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:23:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:55.685352+00:00 (in 9.999349 seconds) notificationworker stdout | 2022-05-05 11:23:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:55 UTC)" (scheduled at 2022-05-05 11:23:45.685352+00:00) notificationworker stdout | 2022-05-05 11:23:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:23:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 45, 686526), True, datetime.datetime(2022, 5, 5, 11, 23, 45, 686526), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:23:45,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:23:45,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:23:45,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:23:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:23:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:23:46,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:16.265236+00:00 (in 29.999452 seconds) buildlogsarchiver stdout | 2022-05-05 11:23:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:24:16 UTC)" (scheduled at 2022-05-05 11:23:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:23:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 23, 46, 266321), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:23:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:23:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:23:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:24:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:23:47,516 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:23:47,517 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:49.523944+00:00 (in 2.006834 seconds) repositorygcworker stdout | 2022-05-05 11:23:47,517 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:28:47 UTC)" (scheduled at 2022-05-05 11:23:47.516588+00:00) repositorygcworker stdout | 2022-05-05 11:23:47,518 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 23, 47, 517592), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:23:47,529 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 23, 47, 517592), True, datetime.datetime(2022, 5, 5, 11, 23, 47, 517592), 0, 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:23:47,532 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 23, 47, 517592), True, datetime.datetime(2022, 5, 5, 11, 23, 47, 517592), 0, 'repositorygc/%', False, datetime.datetime(2022, 5, 5, 11, 23, 47, 517592), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:23:47,533 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:23:47,533 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:28:47 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:23:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:23:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:23:51.436849+00:00 (in 1.912170 seconds) repositorygcworker stdout | 2022-05-05 11:23:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:49 UTC)" (scheduled at 2022-05-05 11:23:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:23:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:23:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:23:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:23:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:49.523944+00:00 (in 58.086352 seconds) repositorygcworker stdout | 2022-05-05 11:23:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:51 UTC)" (scheduled at 2022-05-05 11:23:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:23:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:23:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 51, 438110), True, datetime.datetime(2022, 5, 5, 11, 23, 51, 438110), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:23:51,451 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:23:51,451 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:23:51,451 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:24:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:23:53,920 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:23:54,166 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:23:54,177 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:23:54,220 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:23:54,263 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:23:54,304 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:23:54,367 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:23:54,398 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:23:54,404 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:23:54,480 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:23:54,516 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:23:54,520 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} namespacegcworker stdout | 2022-05-05 11:23:54,532 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:23:54,589 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:23:54,666 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:23:54,689 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:23:54,719 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:23:54,757 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:23:54,824 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:23:54,841 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:23:54,854 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:23:54,861 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:23:54,868 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:23:54,918 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:23:54,925 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:23:54,931 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:23:54,964 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} storagereplication stdout | 2022-05-05 11:23:54,970 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-web stdout | 2022-05-05 11:23:54,985 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:23:54,992 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:23:55,000 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:23:55,006 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:23:55,011 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:23:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:23:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:05.685352+00:00 (in 9.999316 seconds) notificationworker stdout | 2022-05-05 11:23:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:05 UTC)" (scheduled at 2022-05-05 11:23:55.685352+00:00) notificationworker stdout | 2022-05-05 11:23:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:23:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 23, 55, 687047), True, datetime.datetime(2022, 5, 5, 11, 23, 55, 687047), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:23:55,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:23:55,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:23:55,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:23:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:23:58,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:28.857216+00:00 (in 29.999449 seconds) gcworker stdout | 2022-05-05 11:23:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:24:28 UTC)" (scheduled at 2022-05-05 11:23:58.857216+00:00) gcworker stdout | 2022-05-05 11:23:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540238858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:23:58,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:23:58,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:23:58,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:24:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:24:00,722 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:24:00,731 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:24:00,743 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:24:00,753 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:24:00,798 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:24:00,853 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:24:00,859 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:24:00,875 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:24:00,888 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:24:00,888 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:24:00,899 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:24:00,907 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:24:00,914 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:24:00,919 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:24:00,924 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:24:04,044 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:24:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:24:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:15.685352+00:00 (in 9.999297 seconds) notificationworker stdout | 2022-05-05 11:24:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:15 UTC)" (scheduled at 2022-05-05 11:24:05.685352+00:00) notificationworker stdout | 2022-05-05 11:24:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:24:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 5, 686712), True, datetime.datetime(2022, 5, 5, 11, 24, 5, 686712), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:24:05,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:24:05,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:24:05,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:15 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:24:09,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:24:09,794 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:32.794430+00:00 (in 22.999742 seconds) namespacegcworker stdout | 2022-05-05 11:24:09,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:29:09 UTC)" (scheduled at 2022-05-05 11:24:09.794132+00:00) namespacegcworker stdout | 2022-05-05 11:24:09,796 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 24, 9, 795352), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:24:09,808 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 24, 9, 795352), True, datetime.datetime(2022, 5, 5, 11, 24, 9, 795352), 0, 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:24:09,810 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 24, 9, 795352), True, datetime.datetime(2022, 5, 5, 11, 24, 9, 795352), 0, 'namespacegc/%', False, datetime.datetime(2022, 5, 5, 11, 24, 9, 795352), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:24:09,811 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:24:09,811 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:29:09 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:24:10,934 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:24:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:24:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:25.685352+00:00 (in 9.999364 seconds) notificationworker stdout | 2022-05-05 11:24:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:25 UTC)" (scheduled at 2022-05-05 11:24:15.685352+00:00) notificationworker stdout | 2022-05-05 11:24:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:24:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 15, 686595), True, datetime.datetime(2022, 5, 5, 11, 24, 15, 686595), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:24:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:24:15,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:24:15,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:24:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:24:16,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:46.265236+00:00 (in 29.999454 seconds) buildlogsarchiver stdout | 2022-05-05 11:24:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:24:46 UTC)" (scheduled at 2022-05-05 11:24:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:24:16,266 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 24, 16, 266268), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:24:16,279 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:24:16,279 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:24:16,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:24:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:24:23,959 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:24:24,207 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:24:24,212 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:24:24,260 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:24:24,295 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:24:24,319 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:24:24,380 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:24:24,414 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:24:24,439 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:24:24,527 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:24:24,547 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:24:24,553 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} namespacegcworker stdout | 2022-05-05 11:24:24,558 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:24:24,621 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:24:24,695 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:24:24,726 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:24:24,734 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:24:24,793 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:24:24,838 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:24:24,852 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:24:24,863 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:24:24,871 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:24:24,879 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:24:24,931 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:24:24,939 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:24:24,944 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} exportactionlogsworker stdout | 2022-05-05 11:24:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:24:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:26.930811+00:00 (in 1.958900 seconds) exportactionlogsworker stdout | 2022-05-05 11:24:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:24 UTC)" (scheduled at 2022-05-05 11:24:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:24:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:24:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:24 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:24:24,977 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:24:25,000 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:24:25,010 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} storagereplication stdout | 2022-05-05 11:24:25,015 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} gunicorn-web stdout | 2022-05-05 11:24:25,019 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:24:25,026 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:24:25,032 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} notificationworker stdout | 2022-05-05 11:24:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:24:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:32.784864+00:00 (in 7.098895 seconds) notificationworker stdout | 2022-05-05 11:24:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:35 UTC)" (scheduled at 2022-05-05 11:24:25.685352+00:00) notificationworker stdout | 2022-05-05 11:24:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:24:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 25, 686508), True, datetime.datetime(2022, 5, 5, 11, 24, 25, 686508), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:24:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:24:25,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:24:25,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:24:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:24:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:24.971405+00:00 (in 58.039986 seconds) exportactionlogsworker stdout | 2022-05-05 11:24:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:26 UTC)" (scheduled at 2022-05-05 11:24:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:24:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:24:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 26, 932023), True, datetime.datetime(2022, 5, 5, 11, 24, 26, 932023), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:24:26,945 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:24:26,945 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:24:26,945 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:24:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:24:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:58.857216+00:00 (in 29.999290 seconds) gcworker stdout | 2022-05-05 11:24:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:24:58 UTC)" (scheduled at 2022-05-05 11:24:28.857216+00:00) gcworker stdout | 2022-05-05 11:24:28,860 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540268858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:24:28,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:24:28,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:24:28,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:24:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:24:30,738 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:24:30,744 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:24:30,753 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:24:30,764 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:24:30,813 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:24:30,869 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:24:30,876 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:24:30,893 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:24:30,900 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:24:30,907 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:24:30,912 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:24:30,923 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:24:30,928 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:24:30,934 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:24:30,939 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:24:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:24:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:35.685352+00:00 (in 2.899957 seconds) notificationworker stdout | 2022-05-05 11:24:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:32 UTC)" (scheduled at 2022-05-05 11:24:32.784864+00:00) notificationworker stdout | 2022-05-05 11:24:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:24:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:24:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:24:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:38.705240+00:00 (in 5.910236 seconds) namespacegcworker stdout | 2022-05-05 11:24:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:32 UTC)" (scheduled at 2022-05-05 11:24:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:24:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:24:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:32 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:24:34,058 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:24:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:24:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:45.685352+00:00 (in 9.999438 seconds) notificationworker stdout | 2022-05-05 11:24:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:45 UTC)" (scheduled at 2022-05-05 11:24:35.685352+00:00) notificationworker stdout | 2022-05-05 11:24:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:24:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 35, 686513), True, datetime.datetime(2022, 5, 5, 11, 24, 35, 686513), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:24:35,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:24:35,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:24:35,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:45 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:24:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:24:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:32.794430+00:00 (in 54.088639 seconds) namespacegcworker stdout | 2022-05-05 11:24:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:38 UTC)" (scheduled at 2022-05-05 11:24:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:24:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:24:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 38, 706420), True, datetime.datetime(2022, 5, 5, 11, 24, 38, 706420), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:24:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:24:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:24:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:24:40,948 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:24:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:24:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:55.685352+00:00 (in 9.999380 seconds) notificationworker stdout | 2022-05-05 11:24:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:55 UTC)" (scheduled at 2022-05-05 11:24:45.685352+00:00) notificationworker stdout | 2022-05-05 11:24:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:24:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 45, 686611), True, datetime.datetime(2022, 5, 5, 11, 24, 45, 686611), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:24:45,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:24:45,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:24:45,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:24:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:24:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:24:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:16.265236+00:00 (in 29.999256 seconds) buildlogsarchiver stdout | 2022-05-05 11:24:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:25:16 UTC)" (scheduled at 2022-05-05 11:24:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:24:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 24, 46, 266719), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:24:46,280 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:24:46,280 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:24:46,280 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:25:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:24:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:24:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:24:51.436849+00:00 (in 1.912340 seconds) repositorygcworker stdout | 2022-05-05 11:24:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:49 UTC)" (scheduled at 2022-05-05 11:24:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:24:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:24:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:24:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:24:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:49.523944+00:00 (in 58.086495 seconds) repositorygcworker stdout | 2022-05-05 11:24:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:51 UTC)" (scheduled at 2022-05-05 11:24:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:24:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:24:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 51, 437949), True, datetime.datetime(2022, 5, 5, 11, 24, 51, 437949), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:24:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:24:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:24:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:25:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:24:53,999 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:24:54,245 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:24:54,251 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:24:54,292 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:24:54,335 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:24:54,357 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:24:54,413 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:24:54,447 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:24:54,477 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:24:54,566 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:24:54,585 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:24:54,591 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} namespacegcworker stdout | 2022-05-05 11:24:54,600 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:24:54,658 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:24:54,738 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:24:54,770 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:24:54,775 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:24:54,830 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:24:54,850 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:24:54,863 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:24:54,883 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:24:54,890 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:24:54,896 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:24:54,945 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:24:54,956 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:24:54,963 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:24:54,989 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:24:55,012 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:24:55,021 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:24:55,036 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:24:55,042 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:24:55,050 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} storagereplication stdout | 2022-05-05 11:24:55,056 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:24:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:24:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:05.685352+00:00 (in 9.999340 seconds) notificationworker stdout | 2022-05-05 11:24:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:05 UTC)" (scheduled at 2022-05-05 11:24:55.685352+00:00) notificationworker stdout | 2022-05-05 11:24:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:24:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 24, 55, 686558), True, datetime.datetime(2022, 5, 5, 11, 24, 55, 686558), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:24:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:24:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:24:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:24:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:24:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:28.857216+00:00 (in 29.999304 seconds) gcworker stdout | 2022-05-05 11:24:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:25:28 UTC)" (scheduled at 2022-05-05 11:24:58.857216+00:00) gcworker stdout | 2022-05-05 11:24:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540298858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:24:58,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:24:58,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:24:58,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:25:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:25:00,750 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:25:00,762 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:25:00,767 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:25:00,774 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:25:00,830 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:25:00,887 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:25:00,893 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:25:00,906 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:25:00,912 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:25:00,923 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:25:00,928 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:25:00,934 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:25:00,949 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:25:00,954 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:25:00,959 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} gunicorn-registry stdout | 2022-05-05 11:25:04,073 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} notificationworker stdout | 2022-05-05 11:25:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:25:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:15.685352+00:00 (in 9.999435 seconds) notificationworker stdout | 2022-05-05 11:25:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:15 UTC)" (scheduled at 2022-05-05 11:25:05.685352+00:00) notificationworker stdout | 2022-05-05 11:25:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:25:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 5, 686434), True, datetime.datetime(2022, 5, 5, 11, 25, 5, 686434), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:25:05,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:25:05,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:25:05,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:25:10,967 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:25:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:25:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:25.685352+00:00 (in 9.999437 seconds) notificationworker stdout | 2022-05-05 11:25:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:25 UTC)" (scheduled at 2022-05-05 11:25:15.685352+00:00) notificationworker stdout | 2022-05-05 11:25:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:25:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 15, 686505), True, datetime.datetime(2022, 5, 5, 11, 25, 15, 686505), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:25:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:25:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:25:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:25:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:25:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:46.265236+00:00 (in 29.999293 seconds) buildlogsarchiver stdout | 2022-05-05 11:25:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:25:46 UTC)" (scheduled at 2022-05-05 11:25:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:25:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 25, 16, 266513), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:25:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:25:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:25:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:25:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:25:24,016 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} exportactionlogsworker stdout | 2022-05-05 11:25:24,283 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} blobuploadcleanupworker stdout | 2022-05-05 11:25:24,297 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:25:24,330 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:25:24,368 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:25:24,383 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:25:24,439 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:25:24,479 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:25:24,516 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:25:24,604 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:25:24,627 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} expiredappspecifictokenworker stdout | 2022-05-05 11:25:24,634 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} namespacegcworker stdout | 2022-05-05 11:25:24,640 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:25:24,695 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:25:24,771 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:25:24,810 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:25:24,818 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-secscan stdout | 2022-05-05 11:25:24,863 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} servicekey stdout | 2022-05-05 11:25:24,868 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:25:24,874 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:25:24,894 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:25:24,902 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:25:24,909 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:25:24,962 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:25:24,969 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} exportactionlogsworker stdout | 2022-05-05 11:25:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:25:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:26.930811+00:00 (in 1.958874 seconds) exportactionlogsworker stdout | 2022-05-05 11:25:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:24 UTC)" (scheduled at 2022-05-05 11:25:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:25:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:25:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:24 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:25:24,978 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:25:25,001 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:25:25,028 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:25:25,034 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:25:25,047 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:25:25,057 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:25:25,066 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} storagereplication stdout | 2022-05-05 11:25:25,094 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:25:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:25:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:31.783119+00:00 (in 6.097152 seconds) notificationworker stdout | 2022-05-05 11:25:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:35 UTC)" (scheduled at 2022-05-05 11:25:25.685352+00:00) notificationworker stdout | 2022-05-05 11:25:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:25:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 25, 686496), True, datetime.datetime(2022, 5, 5, 11, 25, 25, 686496), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:25:25,709 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:25:25,709 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:25:25,709 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:25:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:25:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:24.970422+00:00 (in 58.038995 seconds) exportactionlogsworker stdout | 2022-05-05 11:25:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:26 UTC)" (scheduled at 2022-05-05 11:25:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:25:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:25:26,932 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 26, 931881), True, datetime.datetime(2022, 5, 5, 11, 25, 26, 931881), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:25:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:25:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:25:26,943 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:25:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:25:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:58.857216+00:00 (in 29.999366 seconds) gcworker stdout | 2022-05-05 11:25:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:25:58 UTC)" (scheduled at 2022-05-05 11:25:28.857216+00:00) gcworker stdout | 2022-05-05 11:25:28,860 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540328858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:25:28,874 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:25:28,874 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:25:28,874 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:25:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:25:30,766 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:25:30,774 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:25:30,782 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:25:30,790 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:25:30,847 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:25:30,903 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:25:30,909 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:25:30,921 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:25:30,926 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:25:30,934 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:25:30,940 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:25:30,953 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:25:30,961 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:25:30,969 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:25:30,974 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:25:31,783 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:25:31,783 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:32.784864+00:00 (in 1.001134 seconds) notificationworker stdout | 2022-05-05 11:25:31,784 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:30:31 UTC)" (scheduled at 2022-05-05 11:25:31.783119+00:00) notificationworker stdout | 2022-05-05 11:25:31,785 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 25, 31, 784323), 'notification/%']) notificationworker stdout | 2022-05-05 11:25:31,796 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 25, 31, 784323), True, datetime.datetime(2022, 5, 5, 11, 25, 31, 784323), 0, 'notification/%']) notificationworker stdout | 2022-05-05 11:25:31,798 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 25, 31, 784323), True, datetime.datetime(2022, 5, 5, 11, 25, 31, 784323), 0, 'notification/%', False, datetime.datetime(2022, 5, 5, 11, 25, 31, 784323), 'notification/%']) notificationworker stdout | 2022-05-05 11:25:31,800 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:25:31,800 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:30:31 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:25:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:25:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:35.685352+00:00 (in 2.899867 seconds) notificationworker stdout | 2022-05-05 11:25:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:32 UTC)" (scheduled at 2022-05-05 11:25:32.784864+00:00) notificationworker stdout | 2022-05-05 11:25:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:25:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:25:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:25:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:38.705240+00:00 (in 5.910172 seconds) namespacegcworker stdout | 2022-05-05 11:25:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:32 UTC)" (scheduled at 2022-05-05 11:25:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:25:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:25:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:25:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:25:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:45.685352+00:00 (in 9.999336 seconds) notificationworker stdout | 2022-05-05 11:25:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:45 UTC)" (scheduled at 2022-05-05 11:25:35.685352+00:00) notificationworker stdout | 2022-05-05 11:25:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:25:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 35, 686619), True, datetime.datetime(2022, 5, 5, 11, 25, 35, 686619), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:25:35,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:25:35,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:25:35,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:25:36,010 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} namespacegcworker stdout | 2022-05-05 11:25:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:25:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:32.794430+00:00 (in 54.088624 seconds) namespacegcworker stdout | 2022-05-05 11:25:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:38 UTC)" (scheduled at 2022-05-05 11:25:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:25:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:25:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 38, 706338), True, datetime.datetime(2022, 5, 5, 11, 25, 38, 706338), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:25:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:25:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:25:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:25:40,984 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:25:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:25:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:55.685352+00:00 (in 9.999345 seconds) notificationworker stdout | 2022-05-05 11:25:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:55 UTC)" (scheduled at 2022-05-05 11:25:45.685352+00:00) notificationworker stdout | 2022-05-05 11:25:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:25:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 45, 686663), True, datetime.datetime(2022, 5, 5, 11, 25, 45, 686663), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:25:45,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:25:45,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:25:45,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:25:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:25:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:25:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:16.265236+00:00 (in 29.999404 seconds) buildlogsarchiver stdout | 2022-05-05 11:25:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:26:16 UTC)" (scheduled at 2022-05-05 11:25:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:25:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 25, 46, 266337), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:25:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:25:46,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:25:46,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:26:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:25:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:25:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:25:51.436849+00:00 (in 1.912390 seconds) repositorygcworker stdout | 2022-05-05 11:25:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:49 UTC)" (scheduled at 2022-05-05 11:25:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:25:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:25:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:25:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:25:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:49.523944+00:00 (in 58.086528 seconds) repositorygcworker stdout | 2022-05-05 11:25:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:51 UTC)" (scheduled at 2022-05-05 11:25:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:25:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:25:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 51, 438065), True, datetime.datetime(2022, 5, 5, 11, 25, 51, 438065), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:25:51,450 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:25:51,450 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:25:51,450 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:26:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:25:54,057 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:25:54,319 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:25:54,326 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:25:54,371 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:25:54,405 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:25:54,422 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:25:54,450 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:25:54,519 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:25:54,546 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:25:54,623 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:25:54,660 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} queuecleanupworker stdout | 2022-05-05 11:25:54,664 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:25:54,671 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:25:54,725 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:25:54,814 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} globalpromstats stdout | 2022-05-05 11:25:54,849 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:25:54,858 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-secscan stdout | 2022-05-05 11:25:54,874 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:25:54,884 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:25:54,904 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} servicekey stdout | 2022-05-05 11:25:54,912 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-secscan stdout | 2022-05-05 11:25:54,920 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:25:54,925 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:25:54,975 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:25:54,981 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:25:54,989 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:25:55,014 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:25:55,040 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:25:55,049 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:25:55,060 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:25:55,069 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:25:55,077 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} storagereplication stdout | 2022-05-05 11:25:55,134 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:25:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:25:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:05.685352+00:00 (in 9.999380 seconds) notificationworker stdout | 2022-05-05 11:25:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:05 UTC)" (scheduled at 2022-05-05 11:25:55.685352+00:00) notificationworker stdout | 2022-05-05 11:25:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:25:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 25, 55, 686551), True, datetime.datetime(2022, 5, 5, 11, 25, 55, 686551), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:25:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:25:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:25:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:25:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:25:58,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:28.857216+00:00 (in 29.999406 seconds) gcworker stdout | 2022-05-05 11:25:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:26:28 UTC)" (scheduled at 2022-05-05 11:25:58.857216+00:00) gcworker stdout | 2022-05-05 11:25:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540358858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:25:58,877 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:25:58,877 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:25:58,877 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:26:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:26:00,781 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:26:00,788 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:26:00,795 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:26:00,807 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:26:00,859 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:26:00,922 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:26:00,928 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:26:00,942 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:26:00,943 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:26:00,952 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:26:00,957 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:26:00,964 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:26:00,975 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:26:00,983 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:26:00,989 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:26:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:26:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:15.685352+00:00 (in 9.999445 seconds) notificationworker stdout | 2022-05-05 11:26:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:15 UTC)" (scheduled at 2022-05-05 11:26:05.685352+00:00) notificationworker stdout | 2022-05-05 11:26:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:26:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 5, 686465), True, datetime.datetime(2022, 5, 5, 11, 26, 5, 686465), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:26:05,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:26:05,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:26:05,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:26:06,024 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:26:11,002 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:26:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:26:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:25.685352+00:00 (in 9.999448 seconds) notificationworker stdout | 2022-05-05 11:26:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:25 UTC)" (scheduled at 2022-05-05 11:26:15.685352+00:00) notificationworker stdout | 2022-05-05 11:26:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:26:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 15, 686431), True, datetime.datetime(2022, 5, 5, 11, 26, 15, 686431), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:26:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:26:15,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:26:15,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:26:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:26:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:46.265236+00:00 (in 29.999255 seconds) buildlogsarchiver stdout | 2022-05-05 11:26:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:26:46 UTC)" (scheduled at 2022-05-05 11:26:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:26:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 26, 16, 266715), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:26:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:26:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:26:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:26:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:26:24,099 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:26:24,359 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:26:24,365 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:26:24,395 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:26:24,433 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:26:24,464 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:26:24,489 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:26:24,558 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:26:24,587 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:26:24,659 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:26:24,684 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:26:24,690 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:26:24,698 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:26:24,760 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:26:24,833 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} teamsyncworker stdout | 2022-05-05 11:26:24,885 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} globalpromstats stdout | 2022-05-05 11:26:24,891 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gunicorn-secscan stdout | 2022-05-05 11:26:24,897 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:26:24,902 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:26:24,915 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:26:24,933 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:26:24,938 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} servicekey stdout | 2022-05-05 11:26:24,948 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} exportactionlogsworker stdout | 2022-05-05 11:26:24,970 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:26:24,971 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:24.971405+00:00 (in 0.000285 seconds) exportactionlogsworker stdout | 2022-05-05 11:26:24,971 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:31:24 UTC)" (scheduled at 2022-05-05 11:26:24.970422+00:00) exportactionlogsworker stdout | 2022-05-05 11:26:24,972 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 26, 24, 971645), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:26:24,973 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:26:24,973 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:26.930811+00:00 (in 1.957209 seconds) exportactionlogsworker stdout | 2022-05-05 11:26:24,973 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:24 UTC)" (scheduled at 2022-05-05 11:26:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:26:24,973 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:26:24,974 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:24 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:26:24,983 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 26, 24, 971645), True, datetime.datetime(2022, 5, 5, 11, 26, 24, 971645), 0, 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:26:24,985 [67] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 26, 24, 971645), True, datetime.datetime(2022, 5, 5, 11, 26, 24, 971645), 0, 'exportactionlogs/%', False, datetime.datetime(2022, 5, 5, 11, 26, 24, 971645), 'exportactionlogs/%']) exportactionlogsworker stdout | 2022-05-05 11:26:24,987 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:26:24,987 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:31:24 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:26:24,991 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:26:24,997 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:26:25,002 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:26:25,025 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:26:25,052 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:26:25,060 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:26:25,076 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:26:25,085 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:26:25,090 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} storagereplication stdout | 2022-05-05 11:26:25,166 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:26:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:26:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:32.784864+00:00 (in 7.098914 seconds) notificationworker stdout | 2022-05-05 11:26:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:35 UTC)" (scheduled at 2022-05-05 11:26:25.685352+00:00) notificationworker stdout | 2022-05-05 11:26:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:26:25,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 25, 686637), True, datetime.datetime(2022, 5, 5, 11, 26, 25, 686637), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:26:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:26:25,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:26:25,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:26:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:26:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:24.971405+00:00 (in 58.039969 seconds) exportactionlogsworker stdout | 2022-05-05 11:26:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:26 UTC)" (scheduled at 2022-05-05 11:26:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:26:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:26:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 26, 932154), True, datetime.datetime(2022, 5, 5, 11, 26, 26, 932154), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:26:26,944 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:26:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:26:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:26:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:26:28,857 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:58.857216+00:00 (in 29.999459 seconds) gcworker stdout | 2022-05-05 11:26:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:26:58 UTC)" (scheduled at 2022-05-05 11:26:28.857216+00:00) gcworker stdout | 2022-05-05 11:26:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540388858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:26:28,870 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:26:28,870 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:26:28,870 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:26:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:26:30,796 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:26:30,803 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:26:30,809 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:26:30,818 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:26:30,871 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:26:30,940 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:26:30,946 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:26:30,954 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:26:30,960 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:26:30,968 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:26:30,974 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:26:30,979 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:26:30,988 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:26:30,997 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:26:31,002 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:26:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:26:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:35.685352+00:00 (in 2.899724 seconds) notificationworker stdout | 2022-05-05 11:26:32,786 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:32 UTC)" (scheduled at 2022-05-05 11:26:32.784864+00:00) notificationworker stdout | 2022-05-05 11:26:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:26:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:26:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:26:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:38.705240+00:00 (in 5.910210 seconds) namespacegcworker stdout | 2022-05-05 11:26:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:32 UTC)" (scheduled at 2022-05-05 11:26:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:26:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:26:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:26:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:26:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:45.685352+00:00 (in 9.999349 seconds) notificationworker stdout | 2022-05-05 11:26:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:45 UTC)" (scheduled at 2022-05-05 11:26:35.685352+00:00) notificationworker stdout | 2022-05-05 11:26:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:26:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 35, 686569), True, datetime.datetime(2022, 5, 5, 11, 26, 35, 686569), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:26:35,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:26:35,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:26:35,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:26:36,037 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} namespacegcworker stdout | 2022-05-05 11:26:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:26:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:32.794430+00:00 (in 54.088595 seconds) namespacegcworker stdout | 2022-05-05 11:26:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:38 UTC)" (scheduled at 2022-05-05 11:26:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:26:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:26:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 38, 706450), True, datetime.datetime(2022, 5, 5, 11, 26, 38, 706450), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:26:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:26:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:26:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:26:41,019 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:26:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:26:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:55.685352+00:00 (in 9.999346 seconds) notificationworker stdout | 2022-05-05 11:26:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:55 UTC)" (scheduled at 2022-05-05 11:26:45.685352+00:00) notificationworker stdout | 2022-05-05 11:26:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:26:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 45, 686534), True, datetime.datetime(2022, 5, 5, 11, 26, 45, 686534), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:26:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:26:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:26:45,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:26:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:26:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:26:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:16.265236+00:00 (in 29.999255 seconds) buildlogsarchiver stdout | 2022-05-05 11:26:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:27:16 UTC)" (scheduled at 2022-05-05 11:26:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:26:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 26, 46, 266466), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:26:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:26:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:26:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:27:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:26:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:26:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:26:51.436849+00:00 (in 1.912264 seconds) repositorygcworker stdout | 2022-05-05 11:26:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:49 UTC)" (scheduled at 2022-05-05 11:26:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:26:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:26:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:26:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:26:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:49.523944+00:00 (in 58.086418 seconds) repositorygcworker stdout | 2022-05-05 11:26:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:51 UTC)" (scheduled at 2022-05-05 11:26:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:26:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:26:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 51, 438065), True, datetime.datetime(2022, 5, 5, 11, 26, 51, 438065), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:26:51,451 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:26:51,451 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:26:51,452 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:27:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:26:54,121 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:26:54,370 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:26:54,401 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:26:54,436 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:26:54,467 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:26:54,502 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:26:54,528 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:26:54,601 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:26:54,606 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:26:54,683 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} queuecleanupworker stdout | 2022-05-05 11:26:54,726 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:26:54,731 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} expiredappspecifictokenworker stdout | 2022-05-05 11:26:54,738 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} manifestbackfillworker stdout | 2022-05-05 11:26:54,795 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:26:54,866 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-secscan stdout | 2022-05-05 11:26:54,911 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} globalpromstats stdout | 2022-05-05 11:26:54,917 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:26:54,924 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-secscan stdout | 2022-05-05 11:26:54,936 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:26:54,947 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:26:54,953 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:26:54,958 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} servicekey stdout | 2022-05-05 11:26:54,988 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-web stdout | 2022-05-05 11:26:55,003 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:26:55,014 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:26:55,019 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:26:55,040 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:26:55,064 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:26:55,073 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:26:55,090 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:26:55,098 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:26:55,105 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} storagereplication stdout | 2022-05-05 11:26:55,201 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:26:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:26:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:05.685352+00:00 (in 9.999471 seconds) notificationworker stdout | 2022-05-05 11:26:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:05 UTC)" (scheduled at 2022-05-05 11:26:55.685352+00:00) notificationworker stdout | 2022-05-05 11:26:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:26:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 26, 55, 686432), True, datetime.datetime(2022, 5, 5, 11, 26, 55, 686432), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:26:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:26:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:26:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:26:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:26:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:28.857216+00:00 (in 29.999362 seconds) gcworker stdout | 2022-05-05 11:26:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:27:28 UTC)" (scheduled at 2022-05-05 11:26:58.857216+00:00) gcworker stdout | 2022-05-05 11:26:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540418858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:26:58,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:26:58,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:26:58,873 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:27:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:27:00,814 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:27:00,820 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:27:00,827 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:27:00,832 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:27:00,886 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:27:00,959 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:27:00,964 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:27:00,970 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:27:00,980 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:27:00,984 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:27:00,989 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:27:00,994 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:27:00,999 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:27:01,009 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:27:01,014 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:27:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:27:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:15.685352+00:00 (in 9.999434 seconds) notificationworker stdout | 2022-05-05 11:27:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:15 UTC)" (scheduled at 2022-05-05 11:27:05.685352+00:00) notificationworker stdout | 2022-05-05 11:27:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:27:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 5, 686748), True, datetime.datetime(2022, 5, 5, 11, 27, 5, 686748), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:27:05,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:27:05,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:27:05,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:27:08,497 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:27:11,038 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:27:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:27:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:25.685352+00:00 (in 9.999423 seconds) notificationworker stdout | 2022-05-05 11:27:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:25 UTC)" (scheduled at 2022-05-05 11:27:15.685352+00:00) notificationworker stdout | 2022-05-05 11:27:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:27:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 15, 686458), True, datetime.datetime(2022, 5, 5, 11, 27, 15, 686458), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:27:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:27:15,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:27:15,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:27:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:27:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:46.265236+00:00 (in 29.999279 seconds) buildlogsarchiver stdout | 2022-05-05 11:27:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:27:46 UTC)" (scheduled at 2022-05-05 11:27:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:27:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 27, 16, 266515), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:27:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:27:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:27:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:27:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:27:24,145 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:27:24,387 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:27:24,441 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:27:24,461 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:27:24,507 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:27:24,539 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:27:24,565 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:27:24,635 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:27:24,641 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:27:24,725 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:27:24,749 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} queuecleanupworker stdout | 2022-05-05 11:27:24,765 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:27:24,770 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:27:24,834 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:27:24,887 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-secscan stdout | 2022-05-05 11:27:24,922 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:27:24,947 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} globalpromstats stdout | 2022-05-05 11:27:24,955 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gunicorn-secscan stdout | 2022-05-05 11:27:24,960 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} teamsyncworker stdout | 2022-05-05 11:27:24,966 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} exportactionlogsworker stdout | 2022-05-05 11:27:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:27:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:26.930811+00:00 (in 1.958595 seconds) gunicorn-secscan stdout | 2022-05-05 11:27:24,972 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} exportactionlogsworker stdout | 2022-05-05 11:27:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:24 UTC)" (scheduled at 2022-05-05 11:27:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:27:24,973 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:27:24,973 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:24 UTC)" executed successfully gunicorn-secscan stdout | 2022-05-05 11:27:24,979 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:27:25,017 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} servicekey stdout | 2022-05-05 11:27:25,026 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-web stdout | 2022-05-05 11:27:25,032 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:27:25,038 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:27:25,051 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:27:25,076 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:27:25,091 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:27:25,100 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:27:25,107 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:27:25,115 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} storagereplication stdout | 2022-05-05 11:27:25,241 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:27:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:27:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:32.784864+00:00 (in 7.098951 seconds) notificationworker stdout | 2022-05-05 11:27:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:35 UTC)" (scheduled at 2022-05-05 11:27:25.685352+00:00) notificationworker stdout | 2022-05-05 11:27:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:27:25,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 25, 686428), True, datetime.datetime(2022, 5, 5, 11, 27, 25, 686428), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:27:25,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:27:25,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:27:25,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:27:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:27:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:24.971405+00:00 (in 58.040048 seconds) exportactionlogsworker stdout | 2022-05-05 11:27:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:26 UTC)" (scheduled at 2022-05-05 11:27:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:27:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:27:26,932 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 26, 931815), True, datetime.datetime(2022, 5, 5, 11, 27, 26, 931815), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:27:26,942 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:27:26,942 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:27:26,942 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:27:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:27:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:58.857216+00:00 (in 29.999396 seconds) gcworker stdout | 2022-05-05 11:27:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:27:58 UTC)" (scheduled at 2022-05-05 11:27:28.857216+00:00) gcworker stdout | 2022-05-05 11:27:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540448858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:27:28,870 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:27:28,870 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:27:28,870 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:27:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:27:30,828 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:27:30,839 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:27:30,840 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:27:30,844 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:27:30,900 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:27:30,970 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:27:30,979 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:27:30,987 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:27:30,992 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:27:30,998 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:27:31,003 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:27:31,009 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:27:31,013 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:27:31,020 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:27:31,025 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:27:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:27:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:35.685352+00:00 (in 2.899946 seconds) notificationworker stdout | 2022-05-05 11:27:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:32 UTC)" (scheduled at 2022-05-05 11:27:32.784864+00:00) notificationworker stdout | 2022-05-05 11:27:32,785 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:27:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:27:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:27:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:38.705240+00:00 (in 5.910240 seconds) namespacegcworker stdout | 2022-05-05 11:27:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:32 UTC)" (scheduled at 2022-05-05 11:27:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:27:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:27:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:27:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:27:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:45.685352+00:00 (in 9.999268 seconds) notificationworker stdout | 2022-05-05 11:27:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:45 UTC)" (scheduled at 2022-05-05 11:27:35.685352+00:00) notificationworker stdout | 2022-05-05 11:27:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:27:35,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 35, 686719), True, datetime.datetime(2022, 5, 5, 11, 27, 35, 686719), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:27:35,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:27:35,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:27:35,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:27:38,512 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} namespacegcworker stdout | 2022-05-05 11:27:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:27:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:32.794430+00:00 (in 54.088633 seconds) namespacegcworker stdout | 2022-05-05 11:27:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:38 UTC)" (scheduled at 2022-05-05 11:27:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:27:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:27:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 38, 706312), True, datetime.datetime(2022, 5, 5, 11, 27, 38, 706312), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:27:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:27:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:27:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:27:41,053 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:27:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:27:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:55.685352+00:00 (in 9.999343 seconds) notificationworker stdout | 2022-05-05 11:27:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:55 UTC)" (scheduled at 2022-05-05 11:27:45.685352+00:00) notificationworker stdout | 2022-05-05 11:27:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:27:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 45, 686684), True, datetime.datetime(2022, 5, 5, 11, 27, 45, 686684), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:27:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:27:45,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:27:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:27:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:27:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:27:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:16.265236+00:00 (in 29.999252 seconds) buildlogsarchiver stdout | 2022-05-05 11:27:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:28:16 UTC)" (scheduled at 2022-05-05 11:27:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:27:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 27, 46, 266561), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:27:46,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:27:46,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:27:46,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:28:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:27:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:27:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:27:51.436849+00:00 (in 1.912250 seconds) repositorygcworker stdout | 2022-05-05 11:27:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:49 UTC)" (scheduled at 2022-05-05 11:27:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:27:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:27:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:27:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:27:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:47.516588+00:00 (in 56.079151 seconds) repositorygcworker stdout | 2022-05-05 11:27:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:51 UTC)" (scheduled at 2022-05-05 11:27:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:27:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:27:51,438 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 51, 437946), True, datetime.datetime(2022, 5, 5, 11, 27, 51, 437946), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:27:51,448 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:27:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:27:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:28:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:27:54,170 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:27:54,426 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:27:54,468 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:27:54,497 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:27:54,550 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:27:54,580 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:27:54,601 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:27:54,676 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:27:54,681 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:27:54,762 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:27:54,780 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} queuecleanupworker stdout | 2022-05-05 11:27:54,806 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:27:54,811 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:27:54,870 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:27:54,928 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-secscan stdout | 2022-05-05 11:27:54,937 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:27:54,956 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:27:54,970 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:27:54,980 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:27:54,990 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} globalpromstats stdout | 2022-05-05 11:27:54,995 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:27:55,003 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-web stdout | 2022-05-05 11:27:55,035 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:27:55,043 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:27:55,049 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:27:55,062 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} servicekey stdout | 2022-05-05 11:27:55,068 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-web stdout | 2022-05-05 11:27:55,088 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:27:55,101 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:27:55,110 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:27:55,117 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:27:55,125 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} storagereplication stdout | 2022-05-05 11:27:55,281 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:27:55,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:27:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:05.685352+00:00 (in 9.999134 seconds) notificationworker stdout | 2022-05-05 11:27:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:05 UTC)" (scheduled at 2022-05-05 11:27:55.685352+00:00) notificationworker stdout | 2022-05-05 11:27:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:27:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 27, 55, 686859), True, datetime.datetime(2022, 5, 5, 11, 27, 55, 686859), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:27:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:27:55,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:27:55,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:05 UTC)" executed successfully gunicorn-web stdout | 2022-05-05 11:27:56,009 [228] [DEBUG] [app] Starting request: urn:request:acbf4369-6c97-4a3e-8649-173130263d14 (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:27:56,009 [228] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:27:56,009 [228] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:27:56,009 [228] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:27:56,010 [229] [DEBUG] [app] Starting request: urn:request:70ce8272-5bea-4c3a-902d-94e2eceddc6b (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:27:56,010 [229] [DEBUG] [auth.oauth] Got invalid bearer token format: Basic cXVheWNvbmZpZzp0ZXN0MTIz gunicorn-web stdout | 2022-05-05 11:27:56,010 [229] [DEBUG] [app] User loader loading deferred user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:27:56,010 [229] [DEBUG] [auth.cookie] Loading user from cookie: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:27:56,011 [229] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:27:56,013 [228] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-web stdout | 2022-05-05 11:27:56,021 [229] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:27:56,021 [229] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:27:56,021 [229] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:27:56,021 [229] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:27:56,021 [229] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:27:56,022 [229] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:27:56,022 [229] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:27:56,022 [229] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:27:56,022 [229] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:27:56,024 [229] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."user_id", "t1"."uuid", "t1"."title", "t1"."token_name", "t1"."token_secret", "t1"."created", "t1"."expiration", "t1"."last_accessed" FROM "appspecificauthtoken" AS "t1" WHERE ((("t1"."user_id" = %s) AND ("t1"."expiration" <= %s)) AND ("t1"."expiration" > %s))', [1, datetime.datetime(2022, 5, 8, 6, 39, 56, 23249), datetime.datetime(2022, 5, 5, 11, 27, 56, 23375)]) gunicorn-web stdout | 2022-05-05 11:27:56,025 [228] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-web stdout | 2022-05-05 11:27:56,025 [228] [DEBUG] [auth.permissions] Identity loaded: gunicorn-web stdout | 2022-05-05 11:27:56,025 [228] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:27:56,025 [228] [DEBUG] [endpoints.api] Checking permission for user ibazulic gunicorn-web stdout | 2022-05-05 11:27:56,025 [228] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-web stdout | 2022-05-05 11:27:56,025 [228] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:27:56,026 [228] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:27:56,026 [228] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-web stdout | 2022-05-05 11:27:56,026 [228] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-web stdout | 2022-05-05 11:27:56,026 [229] [DEBUG] [app] Ending request: urn:request:70ce8272-5bea-4c3a-902d-94e2eceddc6b (/api/v1/user/apptoken) gunicorn-web stdout | 2022-05-05 11:27:56,027 [229] [DEBUG] [data.database] Disconnecting from database. gunicorn-web stdout | 2022-05-05 11:27:56,028 [229] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:27:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:27:56 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.1" 200 38 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.020 979 0.020) gunicorn-web stdout | 2022-05-05 11:27:56,028 [228] [DEBUG] [peewee] ('(SELECT "t1"."id", "t1"."uuid", "t1"."kind_id", "t1"."metadata_json", "t1"."dismissed", "t1"."lookup_path", "t1"."created", "t1"."created" AS "cd", "t1"."target_id" FROM "notification" AS "t1" INNER JOIN "notificationkind" AS "t2" ON ("t1"."kind_id" = "t2"."id") WHERE (("t1"."dismissed" = %s) AND ("t1"."target_id" = %s))) UNION (SELECT "t3"."id", "t3"."uuid", "t3"."kind_id", "t3"."metadata_json", "t3"."dismissed", "t3"."lookup_path", "t3"."created", "t3"."created" AS "cd", "t3"."target_id" FROM "notification" AS "t3" INNER JOIN "notificationkind" AS "t4" ON ("t3"."kind_id" = "t4"."id") INNER JOIN "user" AS "t5" ON ("t5"."id" = "t3"."target_id") INNER JOIN "team" AS "t6" ON ("t5"."id" = "t6"."organization_id") INNER JOIN "teamrole" AS "t7" ON ("t6"."role_id" = "t7"."id") INNER JOIN "teammember" AS "t8" ON ("t6"."id" = "t8"."team_id") INNER JOIN "user" AS "t9" ON ("t8"."user_id" = "t9"."id") WHERE (("t3"."dismissed" = %s) AND (("t9"."id" = %s) AND ("t7"."name" = %s)))) ORDER BY cd desc LIMIT %s', [False, 1, False, 1, 'admin', 6]) gunicorn-web stdout | 2022-05-05 11:27:56,034 [228] [DEBUG] [app] Ending request: urn:request:acbf4369-6c97-4a3e-8649-173130263d14 (/api/v1/user/notifications) gunicorn-web stdout | 2022-05-05 11:27:56,035 [228] [DEBUG] [data.database] Disconnecting from database. nginx stdout | 93.136.90.201 () - quayconfig [05/May/2022:11:27:56 +0000] "GET /api/v1/user/notifications HTTP/1.1" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" (0.028 970 0.028) gunicorn-web stdout | 2022-05-05 11:27:56,035 [228] [INFO] [gunicorn.access] 93.136.90.201 - quayconfig [05/May/2022:11:27:56 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "http://20.67.27.216/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64; rv:100.0) Gecko/20100101 Firefox/100.0" gcworker stdout | 2022-05-05 11:27:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:27:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:28.857216+00:00 (in 29.999358 seconds) gcworker stdout | 2022-05-05 11:27:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:28:28 UTC)" (scheduled at 2022-05-05 11:27:58.857216+00:00) gcworker stdout | 2022-05-05 11:27:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540478858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:27:58,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:27:58,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:27:58,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:28:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:28:00,841 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:28:00,853 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:28:00,855 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:28:00,860 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:28:00,916 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:28:00,985 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:28:00,995 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:28:01,006 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:28:01,012 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:28:01,019 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:28:01,023 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:28:01,028 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:28:01,035 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:28:01,040 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:28:01,046 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:28:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:28:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:15.685352+00:00 (in 9.999359 seconds) notificationworker stdout | 2022-05-05 11:28:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:15 UTC)" (scheduled at 2022-05-05 11:28:05.685352+00:00) notificationworker stdout | 2022-05-05 11:28:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:28:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 5, 686632), True, datetime.datetime(2022, 5, 5, 11, 28, 5, 686632), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:28:05,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:28:05,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:28:05,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:28:08,527 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:28:11,069 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:28:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:28:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:25.685352+00:00 (in 9.999416 seconds) notificationworker stdout | 2022-05-05 11:28:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:25 UTC)" (scheduled at 2022-05-05 11:28:15.685352+00:00) notificationworker stdout | 2022-05-05 11:28:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:28:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 15, 686535), True, datetime.datetime(2022, 5, 5, 11, 28, 15, 686535), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:28:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:28:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:28:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:28:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:28:16,265 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:46.265236+00:00 (in 29.999458 seconds) buildlogsarchiver stdout | 2022-05-05 11:28:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:28:46 UTC)" (scheduled at 2022-05-05 11:28:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:28:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 28, 16, 266320), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:28:16,279 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:28:16,279 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:28:16,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:28:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:28:24,209 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:28:24,466 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} exportactionlogsworker stdout | 2022-05-05 11:28:24,508 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} buildlogsarchiver stdout | 2022-05-05 11:28:24,515 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} builder stdout | 2022-05-05 11:28:24,578 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:28:24,617 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:28:24,639 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:28:24,716 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:28:24,722 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:28:24,803 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:28:24,817 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} queuecleanupworker stdout | 2022-05-05 11:28:24,846 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:28:24,851 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:28:24,912 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gunicorn-secscan stdout | 2022-05-05 11:28:24,948 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gcworker stdout | 2022-05-05 11:28:24,955 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-secscan stdout | 2022-05-05 11:28:24,966 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} exportactionlogsworker stdout | 2022-05-05 11:28:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:28:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:26.930811+00:00 (in 1.958725 seconds) exportactionlogsworker stdout | 2022-05-05 11:28:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:24 UTC)" (scheduled at 2022-05-05 11:28:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:28:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:28:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:24 UTC)" executed successfully gunicorn-secscan stdout | 2022-05-05 11:28:24,982 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:28:24,991 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:28:25,001 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} globalpromstats stdout | 2022-05-05 11:28:25,035 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:28:25,041 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-web stdout | 2022-05-05 11:28:25,047 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:28:25,054 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:28:25,059 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:28:25,078 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:28:25,105 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} servicekey stdout | 2022-05-05 11:28:25,113 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} gunicorn-web stdout | 2022-05-05 11:28:25,120 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:28:25,128 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:28:25,132 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:28:25,137 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} storagereplication stdout | 2022-05-05 11:28:25,319 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:28:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:28:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:32.784864+00:00 (in 7.098853 seconds) notificationworker stdout | 2022-05-05 11:28:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:35 UTC)" (scheduled at 2022-05-05 11:28:25.685352+00:00) notificationworker stdout | 2022-05-05 11:28:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:28:25,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 25, 686720), True, datetime.datetime(2022, 5, 5, 11, 28, 25, 686720), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:28:25,701 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:28:25,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:28:25,702 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:28:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:28:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:24.971405+00:00 (in 58.039892 seconds) exportactionlogsworker stdout | 2022-05-05 11:28:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:26 UTC)" (scheduled at 2022-05-05 11:28:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:28:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:28:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 26, 932115), True, datetime.datetime(2022, 5, 5, 11, 28, 26, 932115), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:28:26,943 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:28:26,943 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:28:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:28:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:28:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:58.857216+00:00 (in 29.999351 seconds) gcworker stdout | 2022-05-05 11:28:28,859 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:28:58 UTC)" (scheduled at 2022-05-05 11:28:28.857216+00:00) gcworker stdout | 2022-05-05 11:28:28,861 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540508860, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:28:28,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:28:28,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:28:28,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:28:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:28:30,856 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:28:30,868 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:28:30,876 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:28:30,881 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:28:30,929 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:28:31,000 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:28:31,010 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:28:31,016 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:28:31,024 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:28:31,034 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:28:31,040 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:28:31,045 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:28:31,052 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:28:31,057 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:28:31,064 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:28:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:28:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:35.685352+00:00 (in 2.899810 seconds) notificationworker stdout | 2022-05-05 11:28:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:32 UTC)" (scheduled at 2022-05-05 11:28:32.784864+00:00) notificationworker stdout | 2022-05-05 11:28:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:28:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:28:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:28:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:38.705240+00:00 (in 5.910239 seconds) namespacegcworker stdout | 2022-05-05 11:28:32,799 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:32 UTC)" (scheduled at 2022-05-05 11:28:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:28:32,799 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:28:32,799 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:28:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:28:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:45.685352+00:00 (in 9.999446 seconds) notificationworker stdout | 2022-05-05 11:28:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:45 UTC)" (scheduled at 2022-05-05 11:28:35.685352+00:00) notificationworker stdout | 2022-05-05 11:28:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:28:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 35, 686434), True, datetime.datetime(2022, 5, 5, 11, 28, 35, 686434), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:28:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:28:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:28:35,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:28:38,546 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} namespacegcworker stdout | 2022-05-05 11:28:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:28:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:09.794132+00:00 (in 31.088344 seconds) namespacegcworker stdout | 2022-05-05 11:28:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:38 UTC)" (scheduled at 2022-05-05 11:28:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:28:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:28:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 38, 706353), True, datetime.datetime(2022, 5, 5, 11, 28, 38, 706353), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:28:38,718 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:28:38,719 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:28:38,719 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:28:41,083 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:28:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:28:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:55.685352+00:00 (in 9.999397 seconds) notificationworker stdout | 2022-05-05 11:28:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:55 UTC)" (scheduled at 2022-05-05 11:28:45.685352+00:00) notificationworker stdout | 2022-05-05 11:28:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:28:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 45, 686648), True, datetime.datetime(2022, 5, 5, 11, 28, 45, 686648), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:28:45,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:28:45,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:28:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:28:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:28:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:28:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:16.265236+00:00 (in 29.999318 seconds) buildlogsarchiver stdout | 2022-05-05 11:28:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:29:16 UTC)" (scheduled at 2022-05-05 11:28:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:28:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 28, 46, 266505), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:28:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:28:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:28:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:29:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:28:47,517 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:28:47,517 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:49.523944+00:00 (in 2.006794 seconds) repositorygcworker stdout | 2022-05-05 11:28:47,517 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:33:47 UTC)" (scheduled at 2022-05-05 11:28:47.516588+00:00) repositorygcworker stdout | 2022-05-05 11:28:47,518 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 28, 47, 517727), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:28:47,531 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 28, 47, 517727), True, datetime.datetime(2022, 5, 5, 11, 28, 47, 517727), 0, 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:28:47,533 [104] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 28, 47, 517727), True, datetime.datetime(2022, 5, 5, 11, 28, 47, 517727), 0, 'repositorygc/%', False, datetime.datetime(2022, 5, 5, 11, 28, 47, 517727), 'repositorygc/%']) repositorygcworker stdout | 2022-05-05 11:28:47,535 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:28:47,535 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:33:47 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:28:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:28:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:28:51.436849+00:00 (in 1.912363 seconds) repositorygcworker stdout | 2022-05-05 11:28:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:49 UTC)" (scheduled at 2022-05-05 11:28:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:28:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:28:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:28:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:28:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:49.523944+00:00 (in 58.086564 seconds) repositorygcworker stdout | 2022-05-05 11:28:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:51 UTC)" (scheduled at 2022-05-05 11:28:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:28:51,437 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:28:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 51, 438011), True, datetime.datetime(2022, 5, 5, 11, 28, 51, 438011), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:28:51,450 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:28:51,450 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:28:51,450 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:29:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:28:54,246 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:28:54,506 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:28:54,542 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} exportactionlogsworker stdout | 2022-05-05 11:28:54,547 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} builder stdout | 2022-05-05 11:28:54,608 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:28:54,652 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:28:54,679 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} notificationworker stdout | 2022-05-05 11:28:54,755 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:28:54,762 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:28:54,842 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:28:54,852 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} queuecleanupworker stdout | 2022-05-05 11:28:54,889 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:28:54,896 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} manifestbackfillworker stdout | 2022-05-05 11:28:54,954 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gunicorn-secscan stdout | 2022-05-05 11:28:54,961 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:28:54,976 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gcworker stdout | 2022-05-05 11:28:54,993 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-secscan stdout | 2022-05-05 11:28:54,999 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:28:55,004 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:28:55,014 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:28:55,070 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:28:55,078 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} globalpromstats stdout | 2022-05-05 11:28:55,088 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gunicorn-web stdout | 2022-05-05 11:28:55,089 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} teamsyncworker stdout | 2022-05-05 11:28:55,095 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-web stdout | 2022-05-05 11:28:55,101 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:28:55,119 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:28:55,137 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:28:55,145 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:28:55,151 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:28:55,158 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} servicekey stdout | 2022-05-05 11:28:55,164 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:28:55,360 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:28:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:28:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:05.685352+00:00 (in 9.999303 seconds) notificationworker stdout | 2022-05-05 11:28:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:05 UTC)" (scheduled at 2022-05-05 11:28:55.685352+00:00) notificationworker stdout | 2022-05-05 11:28:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:28:55,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 28, 55, 686694), True, datetime.datetime(2022, 5, 5, 11, 28, 55, 686694), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:28:55,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:28:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:28:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:28:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:28:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:28.857216+00:00 (in 29.999177 seconds) gcworker stdout | 2022-05-05 11:28:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:29:28 UTC)" (scheduled at 2022-05-05 11:28:58.857216+00:00) gcworker stdout | 2022-05-05 11:28:58,860 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540538858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:28:58,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:28:58,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:28:58,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:29:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:29:00,875 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:29:00,880 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:29:00,888 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:29:00,894 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:29:00,941 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:29:01,017 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:29:01,024 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:29:01,034 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:29:01,034 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:29:01,046 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:29:01,054 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:29:01,059 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:29:01,072 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:29:01,072 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:29:01,080 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:29:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:29:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:15.685352+00:00 (in 9.999381 seconds) notificationworker stdout | 2022-05-05 11:29:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:15 UTC)" (scheduled at 2022-05-05 11:29:05.685352+00:00) notificationworker stdout | 2022-05-05 11:29:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:29:05,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 5, 686647), True, datetime.datetime(2022, 5, 5, 11, 29, 5, 686647), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:29:05,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:29:05,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:29:05,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406?blockid=REDACTED&comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '4194304000' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8e402806-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:29:07,075 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:29:07,077 [231] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: quaystorageaccount2.blob.core.windows.net gunicorn-registry stdout | 2022-05-05 11:29:08,564 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} namespacegcworker stdout | 2022-05-05 11:29:09,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:29:09,794 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:32.794430+00:00 (in 22.999692 seconds) namespacegcworker stdout | 2022-05-05 11:29:09,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:34:09 UTC)" (scheduled at 2022-05-05 11:29:09.794132+00:00) namespacegcworker stdout | 2022-05-05 11:29:09,796 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 29, 9, 795435), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:29:09,807 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 29, 9, 795435), True, datetime.datetime(2022, 5, 5, 11, 29, 9, 795435), 0, 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:29:09,810 [80] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 29, 9, 795435), True, datetime.datetime(2022, 5, 5, 11, 29, 9, 795435), 0, 'namespacegc/%', False, datetime.datetime(2022, 5, 5, 11, 29, 9, 795435), 'namespacegc/%']) namespacegcworker stdout | 2022-05-05 11:29:09,811 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:29:09,811 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:34:09 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:29:11,098 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:29:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:29:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:25.685352+00:00 (in 9.999423 seconds) notificationworker stdout | 2022-05-05 11:29:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:25 UTC)" (scheduled at 2022-05-05 11:29:15.685352+00:00) notificationworker stdout | 2022-05-05 11:29:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:29:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 15, 686527), True, datetime.datetime(2022, 5, 5, 11, 29, 15, 686527), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:29:15,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:29:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:29:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:29:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:29:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:46.265236+00:00 (in 29.999247 seconds) buildlogsarchiver stdout | 2022-05-05 11:29:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:29:46 UTC)" (scheduled at 2022-05-05 11:29:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:29:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 29, 16, 266593), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:29:16,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:29:16,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:29:16,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:29:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:29:24,288 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:29:24,530 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:29:24,583 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} exportactionlogsworker stdout | 2022-05-05 11:29:24,588 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} builder stdout | 2022-05-05 11:29:24,648 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:29:24,694 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:29:24,699 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:29:24,796 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:29:24,802 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:29:24,883 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:29:24,888 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} queuecleanupworker stdout | 2022-05-05 11:29:24,930 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:29:24,938 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} exportactionlogsworker stdout | 2022-05-05 11:29:24,971 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:29:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:26.930811+00:00 (in 1.958838 seconds) exportactionlogsworker stdout | 2022-05-05 11:29:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:24 UTC)" (scheduled at 2022-05-05 11:29:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:29:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:29:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:24 UTC)" executed successfully gunicorn-secscan stdout | 2022-05-05 11:29:24,973 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:29:24,986 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} manifestbackfillworker stdout | 2022-05-05 11:29:24,993 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gunicorn-secscan stdout | 2022-05-05 11:29:25,011 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:29:25,018 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gcworker stdout | 2022-05-05 11:29:25,023 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-secscan stdout | 2022-05-05 11:29:25,030 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gunicorn-web stdout | 2022-05-05 11:29:25,084 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:29:25,090 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:29:25,100 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:29:25,111 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} globalpromstats stdout | 2022-05-05 11:29:25,124 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gunicorn-web stdout | 2022-05-05 11:29:25,135 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} teamsyncworker stdout | 2022-05-05 11:29:25,140 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-web stdout | 2022-05-05 11:29:25,147 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:29:25,155 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:29:25,161 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:29:25,167 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} servicekey stdout | 2022-05-05 11:29:25,204 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:29:25,397 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:29:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:29:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:32.784864+00:00 (in 7.098881 seconds) notificationworker stdout | 2022-05-05 11:29:25,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:35 UTC)" (scheduled at 2022-05-05 11:29:25.685352+00:00) notificationworker stdout | 2022-05-05 11:29:25,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:29:25,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 25, 686701), True, datetime.datetime(2022, 5, 5, 11, 29, 25, 686701), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:29:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:29:25,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:29:25,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:29:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:29:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:24.971405+00:00 (in 58.039966 seconds) exportactionlogsworker stdout | 2022-05-05 11:29:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:26 UTC)" (scheduled at 2022-05-05 11:29:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:29:26,932 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:29:26,933 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 26, 932180), True, datetime.datetime(2022, 5, 5, 11, 29, 26, 932180), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:29:26,946 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:29:26,946 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:29:26,947 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:29:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:29:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:58.857216+00:00 (in 29.999079 seconds) gcworker stdout | 2022-05-05 11:29:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:29:58 UTC)" (scheduled at 2022-05-05 11:29:28.857216+00:00) gcworker stdout | 2022-05-05 11:29:28,860 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540568858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:29:28,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:29:28,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:29:28,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:29:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:29:30,888 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:29:30,898 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:29:30,904 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:29:30,910 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:29:30,958 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:29:31,032 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:29:31,040 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:29:31,049 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:29:31,054 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:29:31,060 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:29:31,069 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:29:31,074 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:29:31,082 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:29:31,088 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:29:31,095 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:29:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:29:32,785 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:35.685352+00:00 (in 2.899870 seconds) notificationworker stdout | 2022-05-05 11:29:32,785 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:32 UTC)" (scheduled at 2022-05-05 11:29:32.784864+00:00) notificationworker stdout | 2022-05-05 11:29:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:29:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:29:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:29:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:38.705240+00:00 (in 5.910155 seconds) namespacegcworker stdout | 2022-05-05 11:29:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:32 UTC)" (scheduled at 2022-05-05 11:29:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:29:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:29:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:29:35,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:29:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:45.685352+00:00 (in 9.999386 seconds) notificationworker stdout | 2022-05-05 11:29:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:45 UTC)" (scheduled at 2022-05-05 11:29:35.685352+00:00) notificationworker stdout | 2022-05-05 11:29:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:29:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 35, 686484), True, datetime.datetime(2022, 5, 5, 11, 29, 35, 686484), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:29:35,697 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:29:35,697 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:29:35,697 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:29:38,579 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} namespacegcworker stdout | 2022-05-05 11:29:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:29:38,706 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:32.794430+00:00 (in 54.088581 seconds) namespacegcworker stdout | 2022-05-05 11:29:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:38 UTC)" (scheduled at 2022-05-05 11:29:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:29:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:29:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 38, 706433), True, datetime.datetime(2022, 5, 5, 11, 29, 38, 706433), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:29:38,719 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:29:38,719 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:29:38,719 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:29:41,116 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:29:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:29:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:55.685352+00:00 (in 9.999415 seconds) notificationworker stdout | 2022-05-05 11:29:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:55 UTC)" (scheduled at 2022-05-05 11:29:45.685352+00:00) notificationworker stdout | 2022-05-05 11:29:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:29:45,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 45, 686583), True, datetime.datetime(2022, 5, 5, 11, 29, 45, 686583), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:29:45,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:29:45,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:29:45,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:29:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:29:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:29:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:16.265236+00:00 (in 29.999194 seconds) buildlogsarchiver stdout | 2022-05-05 11:29:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:30:16 UTC)" (scheduled at 2022-05-05 11:29:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:29:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 29, 46, 266746), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:29:46,279 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:29:46,279 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:29:46,279 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:30:16 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:29:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:29:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:29:51.436849+00:00 (in 1.912314 seconds) repositorygcworker stdout | 2022-05-05 11:29:49,524 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:49 UTC)" (scheduled at 2022-05-05 11:29:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:29:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:29:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:29:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:29:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:49.523944+00:00 (in 58.086307 seconds) repositorygcworker stdout | 2022-05-05 11:29:51,438 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:51 UTC)" (scheduled at 2022-05-05 11:29:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:29:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:29:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 51, 438262), True, datetime.datetime(2022, 5, 5, 11, 29, 51, 438262), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:29:51,449 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:29:51,449 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:29:51,449 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:30:51 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:29:53,121 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406?blockid=MDAwMDA%3D&comp=block HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '521ce5d7-001e-0006-3673-602429000000' gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': '8e402806-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:29:53,122 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:29:52 GMT' logrotateworker stdout | 2022-05-05 11:29:54,317 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:29:54,571 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:29:54,618 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} exportactionlogsworker stdout | 2022-05-05 11:29:54,626 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} builder stdout | 2022-05-05 11:29:54,687 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositorygcworker stdout | 2022-05-05 11:29:54,734 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} repositoryactioncounter stdout | 2022-05-05 11:29:54,740 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} notificationworker stdout | 2022-05-05 11:29:54,837 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} chunkcleanupworker stdout | 2022-05-05 11:29:54,842 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} securityscanningnotificationworker stdout | 2022-05-05 11:29:54,899 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:29:54,908 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} queuecleanupworker stdout | 2022-05-05 11:29:54,943 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} namespacegcworker stdout | 2022-05-05 11:29:54,976 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} gunicorn-secscan stdout | 2022-05-05 11:29:54,984 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:29:54,995 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} gunicorn-secscan stdout | 2022-05-05 11:29:55,023 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} manifestbackfillworker stdout | 2022-05-05 11:29:55,029 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gunicorn-secscan stdout | 2022-05-05 11:29:55,037 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:29:55,043 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} gcworker stdout | 2022-05-05 11:29:55,061 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-web stdout | 2022-05-05 11:29:55,097 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:29:55,102 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:29:55,110 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:29:55,121 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:29:55,145 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:29:55,160 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} globalpromstats stdout | 2022-05-05 11:29:55,165 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} gunicorn-web stdout | 2022-05-05 11:29:55,173 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:29:55,179 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} teamsyncworker stdout | 2022-05-05 11:29:55,185 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} gunicorn-web stdout | 2022-05-05 11:29:55,191 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} servicekey stdout | 2022-05-05 11:29:55,246 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:29:55,440 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:29:55,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:29:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:05.685352+00:00 (in 9.999194 seconds) notificationworker stdout | 2022-05-05 11:29:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:05 UTC)" (scheduled at 2022-05-05 11:29:55.685352+00:00) notificationworker stdout | 2022-05-05 11:29:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:29:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 29, 55, 686749), True, datetime.datetime(2022, 5, 5, 11, 29, 55, 686749), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:29:55,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:29:55,701 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:29:55,701 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:29:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:29:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:28.857216+00:00 (in 29.999358 seconds) gcworker stdout | 2022-05-05 11:29:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:30:28 UTC)" (scheduled at 2022-05-05 11:29:58.857216+00:00) gcworker stdout | 2022-05-05 11:29:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540598858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:29:58,870 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:29:58,870 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:29:58,870 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:30:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:30:00,904 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:30:00,912 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:30:00,927 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:30:00,934 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:30:00,969 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:30:01,046 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:30:01,052 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:30:01,061 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:30:01,066 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:30:01,072 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:30:01,084 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:30:01,088 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:30:01,094 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:30:01,100 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:30:01,108 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:30:05,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:30:05,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:15.685352+00:00 (in 9.999305 seconds) notificationworker stdout | 2022-05-05 11:30:05,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:15 UTC)" (scheduled at 2022-05-05 11:30:05.685352+00:00) notificationworker stdout | 2022-05-05 11:30:05,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:30:05,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 5, 686580), True, datetime.datetime(2022, 5, 5, 11, 30, 5, 686580), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:30:05,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:30:05,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:30:05,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:15 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:30:08,600 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} gunicorn-registry stdout | 2022-05-05 11:30:11,138 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} notificationworker stdout | 2022-05-05 11:30:15,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:30:15,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:25.685352+00:00 (in 9.999435 seconds) notificationworker stdout | 2022-05-05 11:30:15,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:25 UTC)" (scheduled at 2022-05-05 11:30:15.685352+00:00) notificationworker stdout | 2022-05-05 11:30:15,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:30:15,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 15, 686499), True, datetime.datetime(2022, 5, 5, 11, 30, 15, 686499), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:30:15,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:30:15,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:30:15,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:25 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:30:16,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:30:16,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:46.265236+00:00 (in 29.999260 seconds) buildlogsarchiver stdout | 2022-05-05 11:30:16,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:30:46 UTC)" (scheduled at 2022-05-05 11:30:16.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:30:16,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 30, 16, 266530), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:30:16,278 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:30:16,278 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:30:16,278 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:30:46 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:30:24,350 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:30:24,607 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:30:24,638 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} exportactionlogsworker stdout | 2022-05-05 11:30:24,665 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} builder stdout | 2022-05-05 11:30:24,728 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:30:24,754 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:30:24,774 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:30:24,870 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:30:24,875 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:30:24,933 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:30:24,944 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} exportactionlogsworker stdout | 2022-05-05 11:30:24,972 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:30:24,972 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:26.930811+00:00 (in 1.958661 seconds) exportactionlogsworker stdout | 2022-05-05 11:30:24,972 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:24 UTC)" (scheduled at 2022-05-05 11:30:24.971405+00:00) exportactionlogsworker stdout | 2022-05-05 11:30:24,972 [67] [DEBUG] [workers.queueworker] Running watchdog. exportactionlogsworker stdout | 2022-05-05 11:30:24,972 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:24 UTC)" executed successfully queuecleanupworker stdout | 2022-05-05 11:30:24,985 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} gunicorn-secscan stdout | 2022-05-05 11:30:24,993 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:30:25,004 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} namespacegcworker stdout | 2022-05-05 11:30:25,011 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} gunicorn-secscan stdout | 2022-05-05 11:30:25,034 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} gunicorn-secscan stdout | 2022-05-05 11:30:25,046 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:30:25,052 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} manifestbackfillworker stdout | 2022-05-05 11:30:25,068 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gcworker stdout | 2022-05-05 11:30:25,102 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-web stdout | 2022-05-05 11:30:25,110 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:30:25,116 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:30:25,121 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gunicorn-web stdout | 2022-05-05 11:30:25,132 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:30:25,158 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:30:25,170 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:30:25,186 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:30:25,191 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:30:25,200 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} globalpromstats stdout | 2022-05-05 11:30:25,205 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:30:25,220 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:30:25,260 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:30:25,479 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} servicekey stdout | 2022-05-05 11:30:25,624 [114] [DEBUG] [apscheduler.scheduler] Looking for jobs to run servicekey stdout | 2022-05-05 11:30:25,624 [114] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-05-05 11:30:25 UTC)" (scheduled at 2022-05-05 11:30:25.624140+00:00) servicekey stdout | 2022-05-05 11:30:25,625 [114] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 12:25:25.624140+00:00 (in 3299.999637 seconds) servicekey stdout | 2022-05-05 11:30:25,626 [114] [DEBUG] [__main__] Starting automatic refresh of service key nvls5r5iwEKAJwurbbf-Cjm1arc2d2OdNAmUBwZhVAA to new expiration 2022-05-05 13:30:25.625190 servicekey stdout | 2022-05-05 11:30:25,627 [114] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."kid", "t1"."service", "t1"."jwk", "t1"."metadata", "t1"."created_date", "t1"."expiration_date", "t1"."rotation_duration", "t1"."approval_id" FROM "servicekey" AS "t1" LEFT OUTER JOIN "servicekeyapproval" AS "t2" ON ("t1"."approval_id" = "t2"."id") WHERE (("t1"."kid" = %s) AND (NOT ("t1"."expiration_date" <= %s) OR ("t1"."expiration_date" IS %s))) LIMIT %s OFFSET %s', ['nvls5r5iwEKAJwurbbf-Cjm1arc2d2OdNAmUBwZhVAA', datetime.datetime(2022, 4, 28, 11, 30, 25, 626590), None, 1, 0]) servicekey stdout | 2022-05-05 11:30:25,639 [114] [DEBUG] [peewee] ('UPDATE "servicekey" SET "name" = %s, "kid" = %s, "service" = %s, "jwk" = %s, "metadata" = %s, "created_date" = %s, "expiration_date" = %s, "rotation_duration" = %s, "approval_id" = %s WHERE ("servicekey"."id" = %s)', ['http://20.67.27.216:80', 'nvls5r5iwEKAJwurbbf-Cjm1arc2d2OdNAmUBwZhVAA', 'quay', '{"n": "pIr2mYD5wQhWiwX0o2Ngbdx98JVkARxOeTAOJGhdBRs63ObwkKWPR9nrO8sOriRlE_ZjAdCnmUECcr6sIvBEw-DjSy2_jlJVj-OeR2NlYFNlk4TNmZoyUu7RJefJ4S_sxRZSbOcNC-TUQs5SR1igxoHY2_Q1nOgcw7INTUdVn93lL_KyXwL-mcx9cMepM70YoAvshDrOk8AOroJzFnvi64IPPRUUFXl38zniftA2sNqAZxS00me4aHxbhIW9E_vDUrGZJhUjJAUKXv6Ef7x2tBqVakn2hbNsWsTn81S2MeeqE-bewZFFITuu14OwWB2aq1MuGhNBvr1zgEilIo6B8Q", "e": "AQAB", "kty": "RSA", "kid": "nvls5r5iwEKAJwurbbf-Cjm1arc2d2OdNAmUBwZhVAA"}', '{"created_by": "CLI tool"}', datetime.datetime(2022, 5, 5, 11, 1, 43, 217716), datetime.datetime(2022, 5, 5, 13, 30, 25, 625190), None, 1, 1]) servicekey stdout | 2022-05-05 11:30:25,642 [114] [DEBUG] [__main__] Finished automatic refresh of service key nvls5r5iwEKAJwurbbf-Cjm1arc2d2OdNAmUBwZhVAA with new expiration 2022-05-05 13:30:25.625190 servicekey stdout | 2022-05-05 11:30:25,643 [114] [DEBUG] [data.database] Disconnecting from database. servicekey stdout | 2022-05-05 11:30:25,643 [114] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2022-05-05 12:25:25 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:30:25,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:30:25,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:31.783119+00:00 (in 6.097163 seconds) notificationworker stdout | 2022-05-05 11:30:25,687 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:35 UTC)" (scheduled at 2022-05-05 11:30:25.685352+00:00) notificationworker stdout | 2022-05-05 11:30:25,687 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:30:25,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 25, 687695), True, datetime.datetime(2022, 5, 5, 11, 30, 25, 687695), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:30:25,699 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:30:25,699 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:30:25,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:35 UTC)" executed successfully exportactionlogsworker stdout | 2022-05-05 11:30:26,931 [67] [DEBUG] [apscheduler.scheduler] Looking for jobs to run exportactionlogsworker stdout | 2022-05-05 11:30:26,931 [67] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:31:24.970422+00:00 (in 58.039056 seconds) exportactionlogsworker stdout | 2022-05-05 11:30:26,931 [67] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:26 UTC)" (scheduled at 2022-05-05 11:30:26.930811+00:00) exportactionlogsworker stdout | 2022-05-05 11:30:26,931 [67] [DEBUG] [workers.queueworker] Getting work item from queue. exportactionlogsworker stdout | 2022-05-05 11:30:26,932 [67] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 26, 931911), True, datetime.datetime(2022, 5, 5, 11, 30, 26, 931911), 0, 'exportactionlogs/%', 50, 1, 0]) exportactionlogsworker stdout | 2022-05-05 11:30:26,944 [67] [DEBUG] [workers.queueworker] No more work. exportactionlogsworker stdout | 2022-05-05 11:30:26,944 [67] [DEBUG] [data.database] Disconnecting from database. exportactionlogsworker stdout | 2022-05-05 11:30:26,944 [67] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:26 UTC)" executed successfully gcworker stdout | 2022-05-05 11:30:28,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:30:28,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:58.857216+00:00 (in 29.999191 seconds) gcworker stdout | 2022-05-05 11:30:28,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:30:58 UTC)" (scheduled at 2022-05-05 11:30:28.857216+00:00) gcworker stdout | 2022-05-05 11:30:28,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540628858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:30:28,872 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:30:28,872 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:30:28,872 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:30:58 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:30:30,923 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:30:30,929 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:30:30,938 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:30:30,946 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:30:30,981 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:30:31,059 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:30:31,067 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:30:31,079 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:30:31,085 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:30:31,091 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:30:31,097 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:30:31,101 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:30:31,106 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:30:31,113 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:30:31,121 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'} notificationworker stdout | 2022-05-05 11:30:31,783 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:30:31,784 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:32.784864+00:00 (in 1.001178 seconds) notificationworker stdout | 2022-05-05 11:30:31,784 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:35:31 UTC)" (scheduled at 2022-05-05 11:30:31.783119+00:00) notificationworker stdout | 2022-05-05 11:30:31,785 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [False, datetime.datetime(2022, 5, 5, 11, 30, 31, 784348), 'notification/%']) notificationworker stdout | 2022-05-05 11:30:31,794 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 30, 31, 784348), True, datetime.datetime(2022, 5, 5, 11, 30, 31, 784348), 0, 'notification/%']) notificationworker stdout | 2022-05-05 11:30:31,796 [84] [DEBUG] [peewee] ('SELECT COUNT(1) FROM (SELECT DISTINCT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) AND NOT ("t1"."queue_name" IN (SELECT "t1"."queue_name" FROM "queueitem" AS "t1" WHERE ((("t1"."available" = %s) AND ("t1"."processing_expires" > %s)) AND ("t1"."queue_name" ILIKE %s)))))) AS "_wrapped"', [datetime.datetime(2022, 5, 5, 11, 30, 31, 784348), True, datetime.datetime(2022, 5, 5, 11, 30, 31, 784348), 0, 'notification/%', False, datetime.datetime(2022, 5, 5, 11, 30, 31, 784348), 'notification/%']) notificationworker stdout | 2022-05-05 11:30:31,797 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:30:31,798 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2022-05-05 11:35:31 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:30:32,785 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:30:32,786 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:35.685352+00:00 (in 2.899367 seconds) notificationworker stdout | 2022-05-05 11:30:32,786 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:32 UTC)" (scheduled at 2022-05-05 11:30:32.784864+00:00) notificationworker stdout | 2022-05-05 11:30:32,786 [84] [DEBUG] [workers.queueworker] Running watchdog. notificationworker stdout | 2022-05-05 11:30:32,786 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:32 UTC)" executed successfully namespacegcworker stdout | 2022-05-05 11:30:32,794 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:30:32,795 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:38.705240+00:00 (in 5.910197 seconds) namespacegcworker stdout | 2022-05-05 11:30:32,795 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:32 UTC)" (scheduled at 2022-05-05 11:30:32.794430+00:00) namespacegcworker stdout | 2022-05-05 11:30:32,795 [80] [DEBUG] [workers.queueworker] Running watchdog. namespacegcworker stdout | 2022-05-05 11:30:32,795 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:32 UTC)" executed successfully notificationworker stdout | 2022-05-05 11:30:35,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:30:35,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:45.685352+00:00 (in 9.999073 seconds) notificationworker stdout | 2022-05-05 11:30:35,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:45 UTC)" (scheduled at 2022-05-05 11:30:35.685352+00:00) notificationworker stdout | 2022-05-05 11:30:35,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:30:35,687 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 35, 686886), True, datetime.datetime(2022, 5, 5, 11, 30, 35, 686886), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:30:35,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:30:35,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:30:35,699 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:45 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:30:38,617 [231] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '231'} namespacegcworker stdout | 2022-05-05 11:30:38,705 [80] [DEBUG] [apscheduler.scheduler] Looking for jobs to run namespacegcworker stdout | 2022-05-05 11:30:38,705 [80] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:31:32.794430+00:00 (in 54.088653 seconds) namespacegcworker stdout | 2022-05-05 11:30:38,706 [80] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:38 UTC)" (scheduled at 2022-05-05 11:30:38.705240+00:00) namespacegcworker stdout | 2022-05-05 11:30:38,706 [80] [DEBUG] [workers.queueworker] Getting work item from queue. namespacegcworker stdout | 2022-05-05 11:30:38,707 [80] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 38, 706291), True, datetime.datetime(2022, 5, 5, 11, 30, 38, 706291), 0, 'namespacegc/%', 50, 1, 0]) namespacegcworker stdout | 2022-05-05 11:30:38,717 [80] [DEBUG] [workers.queueworker] No more work. namespacegcworker stdout | 2022-05-05 11:30:38,717 [80] [DEBUG] [data.database] Disconnecting from database. namespacegcworker stdout | 2022-05-05 11:30:38,717 [80] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:38 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:30:41,158 [246] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '246'} gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406?blockid=REDACTED&comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '364672717' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cbea6324-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:42,880 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request notificationworker stdout | 2022-05-05 11:30:45,685 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:30:45,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:55.685352+00:00 (in 9.999294 seconds) notificationworker stdout | 2022-05-05 11:30:45,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:55 UTC)" (scheduled at 2022-05-05 11:30:45.685352+00:00) notificationworker stdout | 2022-05-05 11:30:45,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:30:45,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 45, 686976), True, datetime.datetime(2022, 5, 5, 11, 30, 45, 686976), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:30:45,700 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:30:45,700 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:30:45,700 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:30:55 UTC)" executed successfully buildlogsarchiver stdout | 2022-05-05 11:30:46,265 [63] [DEBUG] [apscheduler.scheduler] Looking for jobs to run buildlogsarchiver stdout | 2022-05-05 11:30:46,266 [63] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:31:16.265236+00:00 (in 29.999284 seconds) buildlogsarchiver stdout | 2022-05-05 11:30:46,266 [63] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:31:16 UTC)" (scheduled at 2022-05-05 11:30:46.265236+00:00) buildlogsarchiver stdout | 2022-05-05 11:30:46,267 [63] [DEBUG] [peewee] ('SELECT "candidates"."id" FROM (SELECT "t1"."id" FROM "repositorybuild" AS "t1" WHERE ((("t1"."phase" IN (%s, %s, %s)) OR ("t1"."started" < %s)) AND ("t1"."logs_archived" = %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', ['complete', 'error', 'cancelled', datetime.datetime(2022, 4, 20, 11, 30, 46, 266491), False, 50, 1, 0]) buildlogsarchiver stdout | 2022-05-05 11:30:46,277 [63] [DEBUG] [__main__] No more builds to archive buildlogsarchiver stdout | 2022-05-05 11:30:46,277 [63] [DEBUG] [data.database] Disconnecting from database. buildlogsarchiver stdout | 2022-05-05 11:30:46,277 [63] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2022-05-05 11:31:16 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:30:47,039 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406?blockid=MDAwMDE%3D&comp=block HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:30:47,040 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:30:47,040 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:47,040 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:30:47,040 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,040 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:47,040 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '521dfc77-001e-0006-7973-602429000000' gunicorn-registry stdout | 2022-05-05 11:30:47,040 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cbea6324-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,041 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,041 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,041 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:46 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,044 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['2dab1298-e85a-4bc9-80fb-6eeccf999406', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,047 [231] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '2dab1298-e85a-4bc9-80fb-6eeccf999406', 4558976717, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3jRR3ia/pVD3FhxK6rFyFdEJJrfmmOnSwA+YOsBkqBdgmi2430IAAAACwAA///zhhrOAJjCvAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA0AAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000", "00001"], "content-type": "application/octet-stream"}', 1, 7461836800, datetime.datetime(2022, 5, 5, 11, 15, 51, 817422), None, None, 6]) gunicorn-registry stdout | 2022-05-05 11:30:47,051 [231] [DEBUG] [app] Ending request: urn:request:c83ee7e8-0d8b-489e-86fe-a5234329bf12 (/v2/ibazulic/test-big-layers/blobs/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406) gunicorn-registry stdout | 2022-05-05 11:30:47,051 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:47,051 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:30:47,052 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:47 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406 HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:47 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406 HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (895.195 4560091139 895.160) gunicorn-registry stdout | 2022-05-05 11:30:47,119 [246] [DEBUG] [app] Starting request: urn:request:4e383868-18df-4fd1-b60e-c5da8e912873 (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:30:47,119 [246] [DEBUG] [auth.basic] Attempt to process basic auth header gunicorn-registry stdout | 2022-05-05 11:30:47,120 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."username" = %s) OR ("t1"."email" = %s)) LIMIT %s OFFSET %s', ['ibazulic', 'ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,441 [246] [DEBUG] [auth.credentials] Successfully validated credentials for user ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,441 [246] [DEBUG] [auth.decorators] Found valid auth result: (, False, None, [, None, None, None, None, None]) gunicorn-registry stdout | 2022-05-05 11:30:47,441 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:47,441 [246] [DEBUG] [auth.permissions] Deferring permissions for user with uuid: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:30:47,441 [246] [DEBUG] [endpoints.v2.v2auth] Request audience: 20.67.27.216 gunicorn-registry stdout | 2022-05-05 11:30:47,442 [246] [DEBUG] [endpoints.v2.v2auth] Scope request: ['repository:ibazulic/test-big-layers:push,pull'] gunicorn-registry stdout | 2022-05-05 11:30:47,442 [246] [DEBUG] [endpoints.v2.v2auth] Match: ('ibazulic/test-big-layers', 'ibazulic/test-big-layers', 'push,pull') gunicorn-registry stdout | 2022-05-05 11:30:47,442 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,445 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,446 [246] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:30:47,446 [246] [DEBUG] [auth.permissions] User permission: userspecificneed(type='user', username='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:30:47,447 [246] [DEBUG] [auth.permissions] User namespace permission: namespacewide(type='organization', namespace='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:30:47,447 [246] [DEBUG] [auth.permissions] User namespace repo permission: namespacewide(type='organizationrepo', namespace='ibazulic', role='admin') gunicorn-registry stdout | 2022-05-05 11:30:47,447 [246] [DEBUG] [auth.permissions] Adding superuser to user: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,447 [246] [DEBUG] [auth.permissions] Loading user permissions after deferring for: b412aecc-64cc-42e7-8c69-a105b5da45cd gunicorn-registry stdout | 2022-05-05 11:30:47,454 [246] [DEBUG] [app] Ending request: urn:request:4e383868-18df-4fd1-b60e-c5da8e912873 (/v2/auth) gunicorn-registry stdout | 2022-05-05 11:30:47,454 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:47,455 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:30:47,455 [246] [INFO] [gunicorn.access] 93.136.90.201 - ibazulic [05/May/2022:11:30:47 +0000] "GET /v2/auth?account=ibazulic&scope=repository%3Aibazulic%2Ftest-big-layers%3Apush%2Cpull&service=20.67.27.216 HTTP/1.1" 200 1033 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - ibazulic [05/May/2022:11:30:47 +0000] "GET /v2/auth?account=ibazulic&scope=repository%3Aibazulic%2Ftest-big-layers%3Apush%2Cpull&service=20.67.27.216 HTTP/1.1" 200 1033 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.338 385 0.332) gunicorn-registry stdout | 2022-05-05 11:30:47,456 [246] [DEBUG] [data.userevent] Published user event docker-cli: {'action': 'push_start', 'namespace': 'ibazulic', 'repository': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:47,522 [245] [DEBUG] [app] Starting request: urn:request:b69784a1-721b-465d-a3cc-8b1b7daf33b7 (/v2/ibazulic/test-big-layers/blobs/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406) gunicorn-registry stdout | 2022-05-05 11:30:47,522 [245] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '2dab1298-e85a-4bc9-80fb-6eeccf999406', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:47,522 [245] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:47,522 [245] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:47,523 [245] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:47,523 [245] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,523 [245] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,523 [245] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:30:47,524 [245] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:30:47,525 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,527 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['2dab1298-e85a-4bc9-80fb-6eeccf999406', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,530 [245] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:47,530 [245] [DEBUG] [peewee.pool] Returning 140025700772288 to pool. gunicorn-registry stdout | 2022-05-05 11:30:47,532 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['2dab1298-e85a-4bc9-80fb-6eeccf999406', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,533 [245] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '2dab1298-e85a-4bc9-80fb-6eeccf999406', 4558976717, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3jRR3ia/pVD3FhxK6rFyFdEJJrfmmOnSwA+YOsBkqBdgmi2430IAAAACwAA///zhhrOAJjCvAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAA0AAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000", "00001"], "content-type": "application/octet-stream"}', 2, 7461836800, datetime.datetime(2022, 5, 5, 11, 15, 51, 817422), None, None, 6]) gunicorn-registry stdout | 2022-05-05 11:30:47,537 [245] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:47,537 [245] [DEBUG] [peewee.pool] Returning 140025700772288 to pool. gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e' gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf20650c-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,538 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:47,539 [245] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: quaystorageaccount2.blob.core.windows.net gunicorn-registry stdout | 2022-05-05 11:30:47,643 [245] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 404 0 gunicorn-registry stdout | 2022-05-05 11:30:47,644 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 404 gunicorn-registry stdout | 2022-05-05 11:30:47,644 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:47,644 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Transfer-Encoding': 'chunked' gunicorn-registry stdout | 2022-05-05 11:30:47,644 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:47,644 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': 'dafdc797-501e-0034-4673-60245e000000' gunicorn-registry stdout | 2022-05-05 11:30:47,644 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf20650c-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,644 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,644 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-error-code': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,645 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:46 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406?comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/xml; charset=utf-8' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-content-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '112' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf310998-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:47,647 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,648 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:30:47,658 [245] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406?comp=blocklist HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:30:47 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E8AB366A8E8"' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': 'dafdc7be-501e-0034-6573-60245e000000' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf310998-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-content-crc64': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,659 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:46 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf332eda-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,661 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:47,712 [245] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:30:47 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E8AB36E2261"' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': 'dafdc7cc-501e-0034-7273-60245e000000' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf332eda-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,713 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:46 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e' gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf3b5fd8-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,715 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:47,720 [245] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 200 0 gunicorn-registry stdout | 2022-05-05 11:30:47,720 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 200 gunicorn-registry stdout | 2022-05-05 11:30:47,720 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:47,720 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '4558976717' gunicorn-registry stdout | 2022-05-05 11:30:47,720 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:30:47 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Accept-Ranges': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E8AB36E2261"' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': 'dafdc7f5-501e-0034-1673-60245e000000' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf3b5fd8-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-creation-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-state': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-progress': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-completion-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier-inferred': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,721 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:47 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,722 [245] [DEBUG] [storage.azurestorage] Deleting chunked upload 2dab1298-e85a-4bc9-80fb-6eeccf999406 at path registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406 gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406' gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'DELETE' gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf3ca6fe-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,723 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:47,731 [245] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "DELETE /quayblobstorage/registry/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406 HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:30:47,731 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:30:47,731 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:47,732 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:30:47,732 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:47,732 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': 'dafdc7fc-501e-0034-1d73-60245e000000' gunicorn-registry stdout | 2022-05-05 11:30:47,732 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf3ca6fe-cc66-11ec-b1d0-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:47,732 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,732 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-delete-type-permanent': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:47,732 [245] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:47 GMT' gunicorn-registry stdout | 2022-05-05 11:30:47,733 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['2dab1298-e85a-4bc9-80fb-6eeccf999406', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,734 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "imagestoragelocation" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:30:47,735 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."image_size", "t1"."uncompressed_size", "t1"."uploading", "t1"."cas_path", "t1"."content_checksum" FROM "imagestorage" AS "t1" WHERE ("t1"."content_checksum" = %s) LIMIT %s OFFSET %s', ['sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,737 [245] [DEBUG] [peewee] ('INSERT INTO "imagestorage" ("uuid", "image_size", "uncompressed_size", "uploading", "cas_path", "content_checksum") VALUES (%s, %s, %s, %s, %s, %s) RETURNING "imagestorage"."id"', ['6dd9ee52-d26a-40f5-95af-a7f688d8313f', 4558976717, 7461836800, True, True, 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e']) gunicorn-registry stdout | 2022-05-05 11:30:47,738 [245] [DEBUG] [peewee] ('INSERT INTO "imagestorageplacement" ("storage_id", "location_id") VALUES (%s, %s) RETURNING "imagestorageplacement"."id"', [5, 9]) gunicorn-registry stdout | 2022-05-05 11:30:47,739 [245] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,740 [245] [DEBUG] [peewee] ('INSERT INTO "uploadedblob" ("repository_id", "blob_id", "uploaded_at", "expires_at") VALUES (%s, %s, %s, %s) RETURNING "uploadedblob"."id"', [1, 5, datetime.datetime(2022, 5, 5, 11, 30, 47, 739993), datetime.datetime(2022, 5, 5, 12, 30, 47, 739972)]) gunicorn-registry stdout | 2022-05-05 11:30:47,741 [245] [DEBUG] [peewee] ('DELETE FROM "blobupload" WHERE ("blobupload"."id" = %s)', [6]) gunicorn-registry stdout | 2022-05-05 11:30:47,745 [245] [DEBUG] [app] Ending request: urn:request:b69784a1-721b-465d-a3cc-8b1b7daf33b7 (/v2/ibazulic/test-big-layers/blobs/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406) gunicorn-registry stdout | 2022-05-05 11:30:47,745 [245] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:47,745 [245] [DEBUG] [peewee.pool] Returning 140025700772288 to pool. gunicorn-registry stdout | 2022-05-05 11:30:47,745 [245] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:47 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406?digest=sha256%3A9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:47 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/2dab1298-e85a-4bc9-80fb-6eeccf999406?digest=sha256%3A9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.225 1455 0.224) gunicorn-registry stdout | 2022-05-05 11:30:47,813 [246] [DEBUG] [app] Starting request: urn:request:aaad29f5-eb68-49ff-a851-205a8e5b92cf (/v2/ibazulic/test-big-layers/blobs/sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e) gunicorn-registry stdout | 2022-05-05 11:30:47,813 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:47,814 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:47,814 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:47,816 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:47,816 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,816 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,816 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:30:47,816 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:30:47,816 [246] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2 gunicorn-registry stdout | 2022-05-05 11:30:47,817 [246] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2; calling loader gunicorn-registry stdout | 2022-05-05 11:30:47,819 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,821 [246] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,822 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id", "t2"."id", "t2"."uuid", "t2"."image_size", "t2"."uncompressed_size", "t2"."uploading", "t2"."cas_path", "t2"."content_checksum" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['6dd9ee52-d26a-40f5-95af-a7f688d8313f']) gunicorn-registry stdout | 2022-05-05 11:30:47,824 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['6dd9ee52-d26a-40f5-95af-a7f688d8313f']) gunicorn-registry stdout | 2022-05-05 11:30:47,824 [246] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2: {'uuid': '6dd9ee52-d26a-40f5-95af-a7f688d8313f', 'digest': 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 'compressed_size': 4558976717, 'uncompressed_size': 7461836800, 'uploading': True, 'db_id': 5, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e'}} gunicorn-registry stdout | 2022-05-05 11:30:47,825 [246] [DEBUG] [data.cache.impl] Caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2 with expiration {'uuid': '6dd9ee52-d26a-40f5-95af-a7f688d8313f', 'digest': 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 'compressed_size': 4558976717, 'uncompressed_size': 7461836800, 'uploading': True, 'db_id': 5, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e'}}: 60s gunicorn-registry stdout | 2022-05-05 11:30:47,825 [246] [DEBUG] [data.cache.impl] Cached loaded result for key repo_blob__ibazulic_test-big-layers_sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e_2 with expiration {'uuid': '6dd9ee52-d26a-40f5-95af-a7f688d8313f', 'digest': 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 'compressed_size': 4558976717, 'uncompressed_size': 7461836800, 'uploading': True, 'db_id': 5, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/9d/9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e'}}: 60s gunicorn-registry stdout | 2022-05-05 11:30:47,825 [246] [DEBUG] [app] Ending request: urn:request:aaad29f5-eb68-49ff-a851-205a8e5b92cf (/v2/ibazulic/test-big-layers/blobs/sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e) gunicorn-registry stdout | 2022-05-05 11:30:47,826 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:47,826 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:30:47,826 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:47 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:47 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.015 1360 0.012) gunicorn-registry stdout | 2022-05-05 11:30:47,904 [242] [DEBUG] [app] Starting request: urn:request:8ede5083-10fb-49da-ba3a-aa43a107304f (/v2/ibazulic/test-big-layers/blobs/sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da) gunicorn-registry stdout | 2022-05-05 11:30:47,905 [242] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:47,905 [242] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:47,905 [242] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:47,906 [242] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:47,906 [242] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,906 [242] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,906 [242] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:30:47,906 [242] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:30:47,907 [242] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2 gunicorn-registry stdout | 2022-05-05 11:30:47,907 [242] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2; calling loader gunicorn-registry stdout | 2022-05-05 11:30:47,908 [242] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,911 [242] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,912 [242] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "manifestblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,913 [242] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2: None gunicorn-registry stdout | 2022-05-05 11:30:47,913 [242] [DEBUG] [data.cache.impl] Not caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2: None gunicorn-registry stdout | 2022-05-05 11:30:47,914 [242] [DEBUG] [endpoints.v2] sending response: b'{"errors":[{"code":"BLOB_UNKNOWN","detail":{},"message":"blob unknown to registry"}]}\n' gunicorn-registry stdout | 2022-05-05 11:30:47,914 [242] [DEBUG] [app] Ending request: urn:request:8ede5083-10fb-49da-ba3a-aa43a107304f (/v2/ibazulic/test-big-layers/blobs/sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da) gunicorn-registry stdout | 2022-05-05 11:30:47,915 [242] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:47,915 [242] [DEBUG] [peewee.pool] Returning 140025710710848 to pool. gunicorn-registry stdout | 2022-05-05 11:30:47,915 [242] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:47 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:47 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 404 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.012 1360 0.012) gunicorn-registry stdout | 2022-05-05 11:30:47,981 [231] [DEBUG] [app] Starting request: urn:request:6853212b-faeb-4539-bd53-180617ca28db (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:30:47,981 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:47,981 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:47,981 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:47,982 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:47,982 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,982 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:30:47,982 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:30:47,983 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:30:47,984 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,986 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:47,988 [231] [DEBUG] [peewee] ('INSERT INTO "blobupload" ("repository_id", "uuid", "byte_count", "sha_state", "location_id", "storage_metadata", "chunk_count", "created") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "blobupload"."id"', [1, '29329fb5-8c44-4fd4-aad8-18073845546f', 0, 'gASVqwAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZRoAYwHbWRfZGF0YZRDeGfmCWqFrme7cvNuPDr1T6V/Ug5RjGgFm6vZgx8ZzeBbAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAAACAAAAAAAAAAAAAAAJR1Yi4=', 9, '{"blocks": [], "content-type": null}', 0, datetime.datetime(2022, 5, 5, 11, 30, 47, 987908)]) gunicorn-registry stdout | 2022-05-05 11:30:47,993 [231] [DEBUG] [app] Ending request: urn:request:6853212b-faeb-4539-bd53-180617ca28db (/v2/ibazulic/test-big-layers/blobs/uploads/) gunicorn-registry stdout | 2022-05-05 11:30:47,993 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:47,993 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:30:47,994 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:47 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:47 +0000] "POST /v2/ibazulic/test-big-layers/blobs/uploads/ HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.014 1339 0.012) gunicorn-registry stdout | 2022-05-05 11:30:48,060 [246] [DEBUG] [app] Starting request: urn:request:293ba1be-60f8-46e6-8645-45f3163af68c (/v2/ibazulic/test-big-layers/blobs/uploads/29329fb5-8c44-4fd4-aad8-18073845546f) gunicorn-registry stdout | 2022-05-05 11:30:48,061 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '29329fb5-8c44-4fd4-aad8-18073845546f', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:48,061 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:48,061 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:48,062 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:48,062 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:48,062 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:30:48,062 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:30:48,062 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:30:48,064 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,067 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['29329fb5-8c44-4fd4-aad8-18073845546f', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,069 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:48,069 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/29329fb5-8c44-4fd4-aad8-18073845546f?blockid=REDACTED&comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '2367' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf7196c0-cc66-11ec-8f91-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,070 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,071 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:30:48,072 [246] [DEBUG] [urllib3.connectionpool] Resetting dropped connection: quaystorageaccount2.blob.core.windows.net gunicorn-registry stdout | 2022-05-05 11:30:48,119 [246] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/29329fb5-8c44-4fd4-aad8-18073845546f?blockid=MDAwMDA%3D&comp=block HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-MD5': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': 'e899b127-401e-0028-1373-60763e000000' gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf7196c0-cc66-11ec-8f91-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,120 [246] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:47 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,121 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['29329fb5-8c44-4fd4-aad8-18073845546f', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,123 [246] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '29329fb5-8c44-4fd4-aad8-18073845546f', 2367, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3jRJ3XUrLbwovuoILOgWDmTHdTjAZm9Kx5or0jd5UcThvhJAAAAAAAAMjRhODJkZWFkZjU5Y2MwMzgyY2FlYzY5NmM0ZTUwODMyZDYzOGM5MjdlNTExZWFiMjdhNDg2MGVlMDUiXX19AD8AAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 1, None, datetime.datetime(2022, 5, 5, 11, 30, 47, 987908), None, None, 7]) gunicorn-registry stdout | 2022-05-05 11:30:48,127 [246] [DEBUG] [app] Ending request: urn:request:293ba1be-60f8-46e6-8645-45f3163af68c (/v2/ibazulic/test-big-layers/blobs/uploads/29329fb5-8c44-4fd4-aad8-18073845546f) gunicorn-registry stdout | 2022-05-05 11:30:48,128 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:48,128 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:30:48,128 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:48 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/29329fb5-8c44-4fd4-aad8-18073845546f HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:48 +0000] "PATCH /v2/ibazulic/test-big-layers/blobs/uploads/29329fb5-8c44-4fd4-aad8-18073845546f HTTP/1.1" 202 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.101 3764 0.068) gunicorn-registry stdout | 2022-05-05 11:30:48,196 [231] [DEBUG] [app] Starting request: urn:request:07433d45-8062-4acf-903a-a1d60b4c5de0 (/v2/ibazulic/test-big-layers/blobs/uploads/29329fb5-8c44-4fd4-aad8-18073845546f) gunicorn-registry stdout | 2022-05-05 11:30:48,196 [231] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'upload_uuid': '29329fb5-8c44-4fd4-aad8-18073845546f', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:48,196 [231] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:48,196 [231] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:48,199 [231] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:48,199 [231] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:48,199 [231] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:30:48,199 [231] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:30:48,199 [231] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:30:48,201 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,205 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['29329fb5-8c44-4fd4-aad8-18073845546f', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,206 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:48,206 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:30:48,209 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['29329fb5-8c44-4fd4-aad8-18073845546f', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,210 [231] [DEBUG] [peewee] ('UPDATE "blobupload" SET "repository_id" = %s, "uuid" = %s, "byte_count" = %s, "sha_state" = %s, "location_id" = %s, "storage_metadata" = %s, "chunk_count" = %s, "uncompressed_byte_count" = %s, "created" = %s, "piece_sha_state" = %s, "piece_hashes" = %s WHERE ("blobupload"."id" = %s)', [1, '29329fb5-8c44-4fd4-aad8-18073845546f', 2367, 'gASVsgAAAAAAAACMBnJlaGFzaJSMBnNoYTI1NpSTlCmBlH2UKIwEbmFtZZSMBnNoYTI1NpSMB21kX2RhdGGUQ3jRJ3XUrLbwovuoILOgWDmTHdTjAZm9Kx5or0jd5UcThvhJAAAAAAAAMjRhODJkZWFkZjU5Y2MwMzgyY2FlYzY5NmM0ZTUwODMyZDYzOGM5MjdlNTExZWFiMjdhNDg2MGVlMDUiXX19AD8AAAAgAAAAAAAAAAAAAACUdWIu', 9, '{"blocks": ["00000"], "content-type": "application/octet-stream"}', 2, None, datetime.datetime(2022, 5, 5, 11, 30, 47, 987908), None, None, 7]) gunicorn-registry stdout | 2022-05-05 11:30:48,220 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:48,220 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da' gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf88a5b8-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,221 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 404 0 gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 404 gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Transfer-Encoding': 'chunked' gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '521e0e2c-001e-0006-4e73-602429000000' gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf88a5b8-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-error-code': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,226 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:47 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/29329fb5-8c44-4fd4-aad8-18073845546f?comp=REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/xml; charset=utf-8' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-content-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '87' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf89b8b8-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,228 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] A body is sent with the request gunicorn-registry stdout | 2022-05-05 11:30:48,238 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/uploads/29329fb5-8c44-4fd4-aad8-18073845546f?comp=blocklist HTTP/1.1" 201 0 gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 201 gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:30:48 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E8AB3BF48D8"' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '521e0e32-001e-0006-5473-602429000000' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf89b8b8-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-content-crc64': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,239 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:47 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,240 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da' gunicorn-registry stdout | 2022-05-05 11:30:48,240 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'PUT' gunicorn-registry stdout | 2022-05-05 11:30:48,240 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:48,240 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,240 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,241 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,241 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf8b994e-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,241 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:48,241 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,241 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:48,308 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "PUT /quayblobstorage/registry/sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:30:48,309 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:30:48,309 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:48,309 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:30:48,309 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:30:48 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,309 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E8AB3C896DD"' gunicorn-registry stdout | 2022-05-05 11:30:48,309 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:48,309 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '521e0e40-001e-0006-6173-602429000000' gunicorn-registry stdout | 2022-05-05 11:30:48,309 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf8b994e-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,310 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,310 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,310 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,310 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:48 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da' gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'HEAD' gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf9659ce-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,311 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:48,316 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "HEAD /quayblobstorage/registry/sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 200 0 gunicorn-registry stdout | 2022-05-05 11:30:48,316 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 200 gunicorn-registry stdout | 2022-05-05 11:30:48,316 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:48,316 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '2367' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:30:48 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Accept-Ranges': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E8AB3C896DD"' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '521e0e79-001e-0006-1673-602429000000' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf9659ce-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-creation-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-state': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-progress': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-completion-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-access-tier-inferred': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,317 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:48 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,318 [231] [DEBUG] [storage.azurestorage] Deleting chunked upload 29329fb5-8c44-4fd4-aad8-18073845546f at path registry/uploads/29329fb5-8c44-4fd4-aad8-18073845546f gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/uploads/29329fb5-8c44-4fd4-aad8-18073845546f' gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'DELETE' gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf9789ca-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,319 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "DELETE /quayblobstorage/registry/uploads/29329fb5-8c44-4fd4-aad8-18073845546f HTTP/1.1" 202 0 gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 202 gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '0' gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '521e0e80-001e-0006-1c73-602429000000' gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cf9789ca-cc66-11ec-8f76-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,326 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-delete-type-permanent': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,327 [231] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:48 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,327 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."uuid", "t1"."byte_count", "t1"."sha_state", "t1"."location_id", "t1"."storage_metadata", "t1"."chunk_count", "t1"."uncompressed_byte_count", "t1"."created", "t1"."piece_sha_state", "t1"."piece_hashes", "t2"."id", "t2"."name" FROM "blobupload" AS "t1" INNER JOIN "imagestoragelocation" AS "t2" ON ("t1"."location_id" = "t2"."id") WHERE ("t1"."uuid" = %s) LIMIT %s OFFSET %s', ['29329fb5-8c44-4fd4-aad8-18073845546f', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,329 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."image_size", "t1"."uncompressed_size", "t1"."uploading", "t1"."cas_path", "t1"."content_checksum" FROM "imagestorage" AS "t1" WHERE ("t1"."content_checksum" = %s) LIMIT %s OFFSET %s', ['sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,330 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorage" ("uuid", "image_size", "uncompressed_size", "uploading", "cas_path", "content_checksum") VALUES (%s, %s, %s, %s, %s, %s) RETURNING "imagestorage"."id"', ['2238b759-ffb5-494a-8676-b9abbd98024f', 2367, None, True, True, 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da']) gunicorn-registry stdout | 2022-05-05 11:30:48,331 [231] [DEBUG] [peewee] ('INSERT INTO "imagestorageplacement" ("storage_id", "location_id") VALUES (%s, %s) RETURNING "imagestorageplacement"."id"', [6, 9]) gunicorn-registry stdout | 2022-05-05 11:30:48,332 [231] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state" FROM "repository" AS "t1" WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,333 [231] [DEBUG] [peewee] ('INSERT INTO "uploadedblob" ("repository_id", "blob_id", "uploaded_at", "expires_at") VALUES (%s, %s, %s, %s) RETURNING "uploadedblob"."id"', [1, 6, datetime.datetime(2022, 5, 5, 11, 30, 48, 332733), datetime.datetime(2022, 5, 5, 12, 30, 48, 332722)]) gunicorn-registry stdout | 2022-05-05 11:30:48,333 [231] [DEBUG] [peewee] ('DELETE FROM "blobupload" WHERE ("blobupload"."id" = %s)', [7]) gunicorn-registry stdout | 2022-05-05 11:30:48,338 [231] [DEBUG] [app] Ending request: urn:request:07433d45-8062-4acf-903a-a1d60b4c5de0 (/v2/ibazulic/test-big-layers/blobs/uploads/29329fb5-8c44-4fd4-aad8-18073845546f) gunicorn-registry stdout | 2022-05-05 11:30:48,338 [231] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:48,338 [231] [DEBUG] [peewee.pool] Returning 140025710725568 to pool. nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:48 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/29329fb5-8c44-4fd4-aad8-18073845546f?digest=sha256%3A2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.145 1455 0.144) gunicorn-registry stdout | 2022-05-05 11:30:48,339 [231] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:48 +0000] "PUT /v2/ibazulic/test-big-layers/blobs/uploads/29329fb5-8c44-4fd4-aad8-18073845546f?digest=sha256%3A2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 201 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:30:48,410 [246] [DEBUG] [app] Starting request: urn:request:7f5ddcc6-2ece-4924-8507-2b3875bb3d55 (/v2/ibazulic/test-big-layers/blobs/sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da) gunicorn-registry stdout | 2022-05-05 11:30:48,410 [246] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'digest': 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:48,410 [246] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:48,410 [246] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:48,412 [246] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:48,412 [246] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:48,412 [246] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:30:48,412 [246] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:30:48,412 [246] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:30:48,413 [246] [DEBUG] [data.cache.impl] Checking cache for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2 gunicorn-registry stdout | 2022-05-05 11:30:48,413 [246] [DEBUG] [data.cache.impl] Found no result in cache for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2; calling loader gunicorn-registry stdout | 2022-05-05 11:30:48,414 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,417 [246] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,419 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id", "t2"."id", "t2"."uuid", "t2"."image_size", "t2"."uncompressed_size", "t2"."uploading", "t2"."cas_path", "t2"."content_checksum" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['2238b759-ffb5-494a-8676-b9abbd98024f']) gunicorn-registry stdout | 2022-05-05 11:30:48,420 [246] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['2238b759-ffb5-494a-8676-b9abbd98024f']) gunicorn-registry stdout | 2022-05-05 11:30:48,421 [246] [DEBUG] [data.cache.impl] Got loaded result for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2: {'uuid': '2238b759-ffb5-494a-8676-b9abbd98024f', 'digest': 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 'compressed_size': 2367, 'uncompressed_size': None, 'uploading': True, 'db_id': 6, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da'}} gunicorn-registry stdout | 2022-05-05 11:30:48,421 [246] [DEBUG] [data.cache.impl] Caching loaded result for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2 with expiration {'uuid': '2238b759-ffb5-494a-8676-b9abbd98024f', 'digest': 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 'compressed_size': 2367, 'uncompressed_size': None, 'uploading': True, 'db_id': 6, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da'}}: 60s gunicorn-registry stdout | 2022-05-05 11:30:48,422 [246] [DEBUG] [data.cache.impl] Cached loaded result for key repo_blob__ibazulic_test-big-layers_sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da_2 with expiration {'uuid': '2238b759-ffb5-494a-8676-b9abbd98024f', 'digest': 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 'compressed_size': 2367, 'uncompressed_size': None, 'uploading': True, 'db_id': 6, 'inputs': {'placements': ['default'], 'storage_path': 'sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da'}}: 60s gunicorn-registry stdout | 2022-05-05 11:30:48,422 [246] [DEBUG] [app] Ending request: urn:request:7f5ddcc6-2ece-4924-8507-2b3875bb3d55 (/v2/ibazulic/test-big-layers/blobs/sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da) gunicorn-registry stdout | 2022-05-05 11:30:48,422 [246] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:48,423 [246] [DEBUG] [peewee.pool] Returning 140025700771376 to pool. gunicorn-registry stdout | 2022-05-05 11:30:48,423 [246] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:48 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:48 +0000] "HEAD /v2/ibazulic/test-big-layers/blobs/sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 200 0 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.015 1360 0.008) gunicorn-registry stdout | 2022-05-05 11:30:48,492 [241] [DEBUG] [app] Starting request: urn:request:5d47f43b-8c73-4e07-b289-cbf8fdc86ac4 (/v2/ibazulic/test-big-layers/manifests/latest) gunicorn-registry stdout | 2022-05-05 11:30:48,492 [241] [DEBUG] [auth.registry_jwt_auth] Called with params: (), {'manifest_ref': 'latest', 'namespace_name': 'ibazulic', 'repo_name': 'test-big-layers'} gunicorn-registry stdout | 2022-05-05 11:30:48,493 [241] [DEBUG] [auth.registry_jwt_auth] Validating auth header: Bearer eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:48,493 [241] [DEBUG] [util.security.registry_jwt] encoded JWT: eyJ0eXAiOiJKV1QiLCJhbGciOiJSUzI1NiIsImtpZCI6Im52bHM1cjVpd0VLQUp3dXJiYmYtQ2ptMWFyYzJkMk9kTkFtVUJ3WmhWQUEifQ.eyJpc3MiOiJxdWF5IiwiYXVkIjoiMjAuNjcuMjcuMjE2IiwibmJmIjoxNjUxNzUwMjQ3LCJpYXQiOjE2NTE3NTAyNDcsImV4cCI6MTY1MTc1Mzg0Nywic3ViIjoiaWJhenVsaWMiLCJhY2Nlc3MiOlt7InR5cGUiOiJyZXBvc2l0b3J5IiwibmFtZSI6ImliYXp1bGljL3Rlc3QtYmlnLWxheWVycyIsImFjdGlvbnMiOlsicHVzaCIsInB1bGwiXX1dLCJjb250ZXh0Ijp7InZlcnNpb24iOjIsImVudGl0eV9raW5kIjoidXNlciIsImVudGl0eV9yZWZlcmVuY2UiOiJiNDEyYWVjYy02NGNjLTQyZTctOGM2OS1hMTA1YjVkYTQ1Y2QiLCJraW5kIjoidXNlciIsInVzZXIiOiJpYmF6dWxpYyIsImNvbS5hcG9zdGlsbGUucm9vdHMiOnsiaWJhenVsaWMvdGVzdC1iaWctbGF5ZXJzIjoiJGRpc2FibGVkIn0sImNvbS5hcG9zdGlsbGUucm9vdCI6IiRkaXNhYmxlZCJ9fQ.O0eZc4QfC4fQW9Lzvv3Q0MWyzKU7Cmp88s288ncX0QY2OxSXDcNCU1x_fNNkMbN7Bx_Os3HPDV3eOwT15SdKZTUwLyVCr_toCgXaQY1r8g-xAt6TUq6vtMOiCPNFHlc8S-_N2ulTuoJyOXo6KH6S0pfslihx4nXVXLKEe53dafprSN2ETY5KejkBsKP2iQvtNSEin3yedb1eNm1J2c7MXtCoPJ4OSyhjztrwVdBFDSmzhMkwHJPzSSlkqcZRCuXYX0RmlMZ9xXB4YHZFzWZLTAAjkYaj7IfHUBYX5Jnm1RcBBkiUcrfaMqKcNAghFYHkWbux6AMJjav4iUxnBqC2XA gunicorn-registry stdout | 2022-05-05 11:30:48,495 [241] [DEBUG] [auth.permissions] Identity loaded: gunicorn-registry stdout | 2022-05-05 11:30:48,495 [241] [DEBUG] [auth.permissions] Loaded signed_jwt identity for: ibazulic gunicorn-registry stdout | 2022-05-05 11:30:48,496 [241] [DEBUG] [auth.registry_jwt_auth] Identity changed to ibazulic gunicorn-registry stdout | 2022-05-05 11:30:48,496 [241] [DEBUG] [auth.registry_jwt_auth] Auth context set to {'version': 2, 'entity_kind': 'user', 'entity_reference': 'b412aecc-64cc-42e7-8c69-a105b5da45cd', 'kind': 'user', 'user': 'ibazulic', 'com.apostille.roots': {'ibazulic/test-big-layers': '$disabled'}, 'com.apostille.root': '$disabled'} gunicorn-registry stdout | 2022-05-05 11:30:48,496 [241] [DEBUG] [endpoints.v2] Checking permission for repo: ibazulic/test-big-layers gunicorn-registry stdout | 2022-05-05 11:30:48,501 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."namespace_user_id", "t1"."name", "t1"."visibility_id", "t1"."description", "t1"."badge_token", "t1"."kind_id", "t1"."trust_enabled", "t1"."state", "t2"."id", "t2"."uuid", "t2"."username", "t2"."password_hash", "t2"."email", "t2"."verified", "t2"."stripe_id", "t2"."organization", "t2"."robot", "t2"."invoice_email", "t2"."invalid_login_attempts", "t2"."last_invalid_login", "t2"."removed_tag_expiration_s", "t2"."enabled", "t2"."invoice_email_address", "t2"."given_name", "t2"."family_name", "t2"."company", "t2"."location", "t2"."maximum_queued_builds_count", "t2"."creation_date", "t2"."last_accessed" FROM "repository" AS "t1" INNER JOIN "user" AS "t2" ON ("t1"."namespace_user_id" = "t2"."id") WHERE ((("t2"."username" = %s) AND ("t1"."name" = %s)) AND ("t1"."state" != %s)) LIMIT %s OFFSET %s', ['ibazulic', 'test-big-layers', 3, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,503 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size" FROM "manifest" AS "t1" WHERE (("t1"."repository_id" = %s) AND ("t1"."digest" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:034bf71b04784bc91fee4ed31d2e4321c0f37f165e20d5da2bbae15228db7d38', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,505 [241] [DEBUG] [peewee] ('SELECT "t1"."uuid" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s OFFSET %s', [1, 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,507 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."storage_id", "t1"."location_id", "t2"."id", "t2"."uuid", "t2"."image_size", "t2"."uncompressed_size", "t2"."uploading", "t2"."cas_path", "t2"."content_checksum" FROM "imagestorageplacement" AS "t1" INNER JOIN "imagestorage" AS "t2" ON ("t1"."storage_id" = "t2"."id") WHERE ("t2"."uuid" = %s)', ['2238b759-ffb5-494a-8676-b9abbd98024f']) gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request URL: 'https://quaystorageaccount2.blob.core.windows.net/quayblobstorage/registry/sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request method: 'GET' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] Request headers: gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Accept': 'application/xml' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-range': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-date': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cfb4ed58-cc66-11ec-b0bd-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'User-Agent': 'azsdk-python-storage-blob/12.4.0 Python/3.8.8 (Linux-5.13.0-1022-azure-x86_64-with-glibc2.2.5)' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Authorization': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,513 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] No body was attached to the request gunicorn-registry stdout | 2022-05-05 11:30:48,517 [241] [DEBUG] [urllib3.connectionpool] Starting new HTTPS connection (1): quaystorageaccount2.blob.core.windows.net:443 gunicorn-registry stdout | 2022-05-05 11:30:48,566 [241] [DEBUG] [urllib3.connectionpool] https://quaystorageaccount2.blob.core.windows.net:443 "GET /quayblobstorage/registry/sha256/2a/2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da HTTP/1.1" 206 2367 gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response status: 206 gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] Response headers: gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Length': '2367' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Type': 'application/octet-stream' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Content-Range': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Last-Modified': 'Thu, 05 May 2022 11:30:48 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Accept-Ranges': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'ETag': '"0x8DA2E8AB3C896DD"' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Server': 'Windows-Azure-Blob/1.0 Microsoft-HTTPAPI/2.0' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-request-id': '9d71dc3b-501e-000b-3373-60ecfd000000' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-client-request-id': 'cfb4ed58-cc66-11ec-b0bd-0242ac110002' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-version': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-creation-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-lease-state': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-blob-type': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-id': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-source': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-status': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-progress': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-copy-completion-time': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,567 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'x-ms-server-encrypted': 'REDACTED' gunicorn-registry stdout | 2022-05-05 11:30:48,568 [241] [INFO] [azure.core.pipeline.policies.http_logging_policy] 'Date': 'Thu, 05 May 2022 11:30:48 GMT' gunicorn-registry stdout | 2022-05-05 11:30:48,573 [241] [DEBUG] [peewee] ('((SELECT * FROM (SELECT "t1"."id", "t1"."content_checksum", "t1"."image_size", "t1"."uuid", "t1"."cas_path", "t1"."uncompressed_size" FROM "imagestorage" AS "t1" INNER JOIN "uploadedblob" AS "t2" ON ("t2"."blob_id" = "t1"."id") WHERE (("t2"."repository_id" = %s) AND ("t1"."content_checksum" = %s)) LIMIT %s) AS "q0") UNION ALL ((SELECT * FROM (SELECT "t3"."id", "t3"."content_checksum", "t3"."image_size", "t3"."uuid", "t3"."cas_path", "t3"."uncompressed_size" FROM "imagestorage" AS "t3" INNER JOIN "uploadedblob" AS "t4" ON ("t4"."blob_id" = "t3"."id") WHERE (("t4"."repository_id" = %s) AND ("t3"."content_checksum" = %s)) LIMIT %s) AS "q1") UNION ALL (SELECT * FROM (SELECT "t5"."id", "t5"."content_checksum", "t5"."image_size", "t5"."uuid", "t5"."cas_path", "t5"."uncompressed_size" FROM "imagestorage" AS "t5" INNER JOIN "uploadedblob" AS "t6" ON ("t6"."blob_id" = "t5"."id") WHERE (("t6"."repository_id" = %s) AND ("t5"."content_checksum" = %s)) LIMIT %s) AS "q2"))) UNION ALL ((SELECT * FROM (SELECT "t3"."id", "t3"."content_checksum", "t3"."image_size", "t3"."uuid", "t3"."cas_path", "t3"."uncompressed_size" FROM "imagestorage" AS "t3" INNER JOIN "uploadedblob" AS "t4" ON ("t4"."blob_id" = "t3"."id") WHERE (("t4"."repository_id" = %s) AND ("t3"."content_checksum" = %s)) LIMIT %s) AS "q3") UNION ALL ((SELECT * FROM (SELECT "t5"."id", "t5"."content_checksum", "t5"."image_size", "t5"."uuid", "t5"."cas_path", "t5"."uncompressed_size" FROM "imagestorage" AS "t5" INNER JOIN "uploadedblob" AS "t6" ON ("t6"."blob_id" = "t5"."id") WHERE (("t6"."repository_id" = %s) AND ("t5"."content_checksum" = %s)) LIMIT %s) AS "q4") UNION ALL (SELECT * FROM (SELECT "t7"."id", "t7"."content_checksum", "t7"."image_size", "t7"."uuid", "t7"."cas_path", "t7"."uncompressed_size" FROM "imagestorage" AS "t7" INNER JOIN "uploadedblob" AS "t8" ON ("t8"."blob_id" = "t7"."id") WHERE (("t8"."repository_id" = %s) AND ("t7"."content_checksum" = %s)) LIMIT %s) AS "q5")))', [1, 'sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1', 1, 1, 'sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e', 1, 1, 'sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a', 1, 1, 'sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da', 1, 1, 'sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c', 1, 1, 'sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1', 1]) gunicorn-registry stdout | 2022-05-05 11:30:48,577 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "mediatype" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:30:48,579 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size" FROM "manifest" AS "t1" WHERE (("t1"."digest" = %s) AND ("t1"."repository_id" = %s)) LIMIT %s OFFSET %s', ['sha256:034bf71b04784bc91fee4ed31d2e4321c0f37f165e20d5da2bbae15228db7d38', 1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,581 [241] [DEBUG] [peewee] ('INSERT INTO "manifest" ("repository_id", "digest", "media_type_id", "manifest_bytes", "config_media_type", "layers_compressed_size") VALUES (%s, %s, %s, %s, %s, %s) RETURNING "manifest"."id"', [1, 'sha256:034bf71b04784bc91fee4ed31d2e4321c0f37f165e20d5da2bbae15228db7d38', 16, '{\n "schemaVersion": 2,\n "mediaType": "application/vnd.docker.distribution.manifest.v2+json",\n "config": {\n "mediaType": "application/vnd.docker.container.image.v1+json",\n "size": 2367,\n "digest": "sha256:2a5ef17910c0140f1766930b872040f998433f7535d4eb8c668328c505d516da"\n },\n "layers": [\n {\n "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",\n "size": 54941777,\n "digest": "sha256:6aefca2dc61dcbcd268b8a9861e552f9cdb69e57242faec64ac120d2355a9c1a"\n },\n {\n "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",\n "size": 13736270,\n "digest": "sha256:8672471369bd52072d12facd78bc30668b7c048c6cc1c2fcef4ce38031d286e1"\n },\n {\n "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",\n "size": 585146,\n "digest": "sha256:93110824cee542506134474bc74c26ddfea83d29642668de123fca185d806dd1"\n },\n {\n "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",\n "size": 4558976717,\n "digest": "sha256:9d89c9285e5e528fe03a73e17794e9ee2a9146135142c6ae2aa4f35a6a7a132e"\n },\n {\n "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip",\n "size": 964328669,\n "digest": "sha256:273dd1a185869fc9c860e31ed970052b87528d591ac858f93f017d127be3ca9c"\n }\n ]\n}', 'application/vnd.docker.container.image.v1+json', 5592568579]) gunicorn-registry stdout | 2022-05-05 11:30:48,583 [241] [DEBUG] [peewee] ('INSERT INTO "manifestblob" ("repository_id", "manifest_id", "blob_id") VALUES (%s, %s, %s), (%s, %s, %s), (%s, %s, %s), (%s, %s, %s), (%s, %s, %s), (%s, %s, %s) RETURNING "manifestblob"."id"', [1, 1, 1, 1, 1, 2, 1, 1, 3, 1, 1, 4, 1, 1, 5, 1, 1, 6]) gunicorn-registry stdout | 2022-05-05 11:30:48,588 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."repository_id", "t1"."digest", "t1"."media_type_id", "t1"."manifest_bytes", "t1"."config_media_type", "t1"."layers_compressed_size", "t2"."id", "t2"."name" FROM "manifest" AS "t1" INNER JOIN "mediatype" AS "t2" ON ("t1"."media_type_id" = "t2"."id") WHERE ("t1"."id" = %s) LIMIT %s OFFSET %s', [1, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,590 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name", "t1"."repository_id", "t1"."manifest_id", "t1"."lifetime_start_ms", "t1"."lifetime_end_ms", "t1"."hidden", "t1"."reversion", "t1"."tag_kind_id", "t1"."linked_tag_id", "t2"."id", "t2"."repository_id", "t2"."digest", "t2"."media_type_id", "t2"."manifest_bytes", "t2"."config_media_type", "t2"."layers_compressed_size" FROM "tag" AS "t1" INNER JOIN "manifest" AS "t2" ON ("t1"."manifest_id" = "t2"."id") WHERE (((("t1"."repository_id" = %s) AND ("t1"."name" = %s)) AND (("t1"."lifetime_end_ms" IS %s) OR ("t1"."lifetime_end_ms" > %s))) AND ("t1"."hidden" = %s)) LIMIT %s OFFSET %s', [1, 'latest', None, 1651750248589, False, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,593 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "tagkind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:30:48,594 [241] [DEBUG] [peewee] ('INSERT INTO "tag" ("name", "repository_id", "manifest_id", "lifetime_start_ms", "lifetime_end_ms", "hidden", "reversion", "tag_kind_id") VALUES (%s, %s, %s, %s, %s, %s, %s, %s) RETURNING "tag"."id"', ['latest', 1, 1, 1651750248589, None, False, False, 1]) gunicorn-registry stdout | 2022-05-05 11:30:48,604 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE (("t1"."uuid" = %s) AND ("t1"."organization" = %s)) LIMIT %s OFFSET %s', ['b412aecc-64cc-42e7-8c69-a105b5da45cd', False, 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,605 [241] [DEBUG] [util.audit] Checking publishing push_repo to the user events system gunicorn-registry stdout | 2022-05-05 11:30:48,605 [241] [DEBUG] [util.audit] Publishing push_repo to the user events system gunicorn-registry stdout | 2022-05-05 11:30:48,606 [241] [DEBUG] [util.audit] Logging the push_repo to analytics engine gunicorn-registry stdout | 2022-05-05 11:30:48,606 [241] [DEBUG] [util.audit] Resolving IP address 93.136.90.201 gunicorn-registry stdout | 2022-05-05 11:30:48,608 [241] [DEBUG] [util.audit] Resolved IP address 93.136.90.201 gunicorn-registry stdout | 2022-05-05 11:30:48,608 [241] [DEBUG] [util.audit] Logging the push_repo to logs system gunicorn-registry stdout | 2022-05-05 11:30:48,609 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."username", "t1"."password_hash", "t1"."email", "t1"."verified", "t1"."stripe_id", "t1"."organization", "t1"."robot", "t1"."invoice_email", "t1"."invalid_login_attempts", "t1"."last_invalid_login", "t1"."removed_tag_expiration_s", "t1"."enabled", "t1"."invoice_email_address", "t1"."given_name", "t1"."family_name", "t1"."company", "t1"."location", "t1"."maximum_queued_builds_count", "t1"."creation_date", "t1"."last_accessed" FROM "user" AS "t1" WHERE ("t1"."username" = %s) LIMIT %s OFFSET %s', ['ibazulic', 1, 0]) gunicorn-registry stdout | 2022-05-05 11:30:48,610 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."name" FROM "logentrykind" AS "t1"', []) gunicorn-registry stdout | 2022-05-05 11:30:48,612 [241] [DEBUG] [peewee] ('INSERT INTO "logentry3" ("kind_id", "account_id", "performer_id", "repository_id", "datetime", "ip", "metadata_json") VALUES (%s, %s, %s, %s, %s, %s, %s) RETURNING "logentry3"."id"', [42, 1, 1, 1, datetime.datetime(2022, 5, 5, 11, 30, 48, 608528), '93.136.90.201', '{"repo": "test-big-layers", "namespace": "ibazulic", "user-agent": "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \\\\(linux\\\\))", "tag": "latest", "username": "ibazulic", "resolved_ip": {"provider": "internet", "service": "HR", "sync_token": "1642551203", "country_iso_code": "HR"}}']) gunicorn-registry stdout | 2022-05-05 11:30:48,616 [241] [DEBUG] [util.audit] Track and log of push_repo complete gunicorn-registry stdout | 2022-05-05 11:30:48,618 [241] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."uuid", "t1"."repository_id", "t1"."event_id", "t1"."method_id", "t1"."title", "t1"."config_json", "t1"."event_config_json", "t1"."number_of_failures", "t2"."id", "t2"."namespace_user_id", "t2"."name", "t2"."visibility_id", "t2"."description", "t2"."badge_token", "t2"."kind_id", "t2"."trust_enabled", "t2"."state", "t3"."id", "t3"."uuid", "t3"."username", "t3"."password_hash", "t3"."email", "t3"."verified", "t3"."stripe_id", "t3"."organization", "t3"."robot", "t3"."invoice_email", "t3"."invalid_login_attempts", "t3"."last_invalid_login", "t3"."removed_tag_expiration_s", "t3"."enabled", "t3"."invoice_email_address", "t3"."given_name", "t3"."family_name", "t3"."company", "t3"."location", "t3"."maximum_queued_builds_count", "t3"."creation_date", "t3"."last_accessed" FROM "repositorynotification" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") INNER JOIN "externalnotificationevent" AS "t4" ON ("t1"."event_id" = "t4"."id") WHERE ((("t3"."username" = %s) AND ("t2"."name" = %s)) AND ("t4"."name" = %s))', ['ibazulic', 'test-big-layers', 'repo_push']) gunicorn-registry stdout | 2022-05-05 11:30:48,620 [241] [DEBUG] [app] Ending request: urn:request:5d47f43b-8c73-4e07-b289-cbf8fdc86ac4 (/v2/ibazulic/test-big-layers/manifests/latest) gunicorn-registry stdout | 2022-05-05 11:30:48,621 [241] [DEBUG] [data.database] Disconnecting from database. gunicorn-registry stdout | 2022-05-05 11:30:48,621 [241] [DEBUG] [peewee.pool] Returning 140025710706752 to pool. gunicorn-registry stdout | 2022-05-05 11:30:48,621 [241] [INFO] [gunicorn.access] 93.136.90.201 - - [05/May/2022:11:30:48 +0000] "PUT /v2/ibazulic/test-big-layers/manifests/latest HTTP/1.1" 201 2 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \(linux\))" gunicorn-registry stdout | 2022-05-05 11:30:48,622 [241] [DEBUG] [data.userevent] Published user event docker-cli: {'action': 'push_repo', 'repository': 'test-big-layers', 'namespace': 'ibazulic'} nginx stdout | 93.136.90.201 () - - [05/May/2022:11:30:48 +0000] "PUT /v2/ibazulic/test-big-layers/manifests/latest HTTP/1.1" 201 2 "-" "docker/20.10.14 go/go1.16.15 git-commit/87a90dc kernel/5.10.0-13-amd64 os/linux arch/amd64 UpstreamClient(Docker-Client/20.10.14 \x5C(linux\x5C))" (0.164 2789 0.128) repositorygcworker stdout | 2022-05-05 11:30:49,524 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:30:49,524 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:30:51.436849+00:00 (in 1.912202 seconds) repositorygcworker stdout | 2022-05-05 11:30:49,525 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:49 UTC)" (scheduled at 2022-05-05 11:30:49.523944+00:00) repositorygcworker stdout | 2022-05-05 11:30:49,525 [104] [DEBUG] [workers.queueworker] Running watchdog. repositorygcworker stdout | 2022-05-05 11:30:49,525 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:49 UTC)" executed successfully repositorygcworker stdout | 2022-05-05 11:30:51,437 [104] [DEBUG] [apscheduler.scheduler] Looking for jobs to run repositorygcworker stdout | 2022-05-05 11:30:51,437 [104] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:31:49.523944+00:00 (in 58.086437 seconds) repositorygcworker stdout | 2022-05-05 11:30:51,437 [104] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:51 UTC)" (scheduled at 2022-05-05 11:30:51.436849+00:00) repositorygcworker stdout | 2022-05-05 11:30:51,438 [104] [DEBUG] [workers.queueworker] Getting work item from queue. repositorygcworker stdout | 2022-05-05 11:30:51,439 [104] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 51, 438249), True, datetime.datetime(2022, 5, 5, 11, 30, 51, 438249), 0, 'repositorygc/%', 50, 1, 0]) repositorygcworker stdout | 2022-05-05 11:30:51,450 [104] [DEBUG] [workers.queueworker] No more work. repositorygcworker stdout | 2022-05-05 11:30:51,450 [104] [DEBUG] [data.database] Disconnecting from database. repositorygcworker stdout | 2022-05-05 11:30:51,450 [104] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2022-05-05 11:31:51 UTC)" executed successfully logrotateworker stdout | 2022-05-05 11:30:54,386 [74] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'logrotateworker.py', 'pid': '74'} blobuploadcleanupworker stdout | 2022-05-05 11:30:54,651 [61] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'blobuploadcleanupworker.py', 'pid': '61'} buildlogsarchiver stdout | 2022-05-05 11:30:54,678 [63] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'buildlogsarchiver.py', 'pid': '63'} exportactionlogsworker stdout | 2022-05-05 11:30:54,694 [67] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'exportactionlogsworker.py', 'pid': '67'} builder stdout | 2022-05-05 11:30:54,765 [62] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'builder.py', 'pid': '62'} repositoryactioncounter stdout | 2022-05-05 11:30:54,793 [102] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositoryactioncounter.py', 'pid': '102'} repositorygcworker stdout | 2022-05-05 11:30:54,812 [104] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'repositorygcworker.py', 'pid': '104'} chunkcleanupworker stdout | 2022-05-05 11:30:54,898 [64] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'chunkcleanupworker.py', 'pid': '64'} notificationworker stdout | 2022-05-05 11:30:54,912 [84] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'notificationworker.py', 'pid': '84'} securityscanningnotificationworker stdout | 2022-05-05 11:30:54,972 [106] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'securityscanningnotificationworker.py', 'pid': '106'} expiredappspecifictokenworker stdout | 2022-05-05 11:30:54,978 [66] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'expiredappspecifictokenworker.py', 'pid': '66'} gunicorn-secscan stdout | 2022-05-05 11:30:55,004 [219] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '219'} gunicorn-secscan stdout | 2022-05-05 11:30:55,013 [216] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '216'} queuecleanupworker stdout | 2022-05-05 11:30:55,019 [98] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'queuecleanupworker.py', 'pid': '98'} gunicorn-secscan stdout | 2022-05-05 11:30:55,048 [71] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '71'} namespacegcworker stdout | 2022-05-05 11:30:55,053 [80] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'namespacegcworker.py', 'pid': '80'} gunicorn-secscan stdout | 2022-05-05 11:30:55,059 [218] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '218'} gunicorn-secscan stdout | 2022-05-05 11:30:55,064 [214] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'secscan:application', 'pid': '214'} manifestbackfillworker stdout | 2022-05-05 11:30:55,095 [75] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'manifestbackfillworker.py', 'pid': '75'} gunicorn-web stdout | 2022-05-05 11:30:55,123 [222] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '222'} gunicorn-web stdout | 2022-05-05 11:30:55,129 [228] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '228'} gunicorn-web stdout | 2022-05-05 11:30:55,134 [229] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '229'} gcworker stdout | 2022-05-05 11:30:55,140 [68] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'gcworker.py', 'pid': '68'} gunicorn-web stdout | 2022-05-05 11:30:55,145 [230] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '230'} gunicorn-web stdout | 2022-05-05 11:30:55,172 [225] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '225'} gunicorn-web stdout | 2022-05-05 11:30:55,181 [227] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '227'} gunicorn-web stdout | 2022-05-05 11:30:55,196 [226] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '226'} gunicorn-web stdout | 2022-05-05 11:30:55,201 [224] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '224'} gunicorn-web stdout | 2022-05-05 11:30:55,210 [72] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'web:application', 'pid': '72'} globalpromstats stdout | 2022-05-05 11:30:55,238 [69] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'globalpromstats.py', 'pid': '69'} teamsyncworker stdout | 2022-05-05 11:30:55,255 [117] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'teamsyncworker.py', 'pid': '117'} servicekey stdout | 2022-05-05 11:30:55,300 [114] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'servicekeyworker.py', 'pid': '114'} storagereplication stdout | 2022-05-05 11:30:55,523 [115] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'storagereplication.py', 'pid': '115'} notificationworker stdout | 2022-05-05 11:30:55,686 [84] [DEBUG] [apscheduler.scheduler] Looking for jobs to run notificationworker stdout | 2022-05-05 11:30:55,686 [84] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:31:05.685352+00:00 (in 9.999178 seconds) notificationworker stdout | 2022-05-05 11:30:55,686 [84] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:31:05 UTC)" (scheduled at 2022-05-05 11:30:55.685352+00:00) notificationworker stdout | 2022-05-05 11:30:55,686 [84] [DEBUG] [workers.queueworker] Getting work item from queue. notificationworker stdout | 2022-05-05 11:30:55,688 [84] [DEBUG] [peewee] ('SELECT "t1"."id", "t1"."queue_name", "t1"."body", "t1"."available_after", "t1"."available", "t1"."processing_expires", "t1"."retries_remaining", "t1"."state_id" FROM "queueitem" AS "t1" INNER JOIN (SELECT "t1"."id" FROM "queueitem" AS "t1" WHERE (((("t1"."available_after" <= %s) AND (("t1"."available" = %s) OR ("t1"."processing_expires" <= %s))) AND ("t1"."retries_remaining" > %s)) AND ("t1"."queue_name" ILIKE %s)) LIMIT %s) AS "j1" ON ("t1"."id" = "j1"."id") ORDER BY Random() LIMIT %s OFFSET %s', [datetime.datetime(2022, 5, 5, 11, 30, 55, 686822), True, datetime.datetime(2022, 5, 5, 11, 30, 55, 686822), 0, 'notification/%', 50, 1, 0]) notificationworker stdout | 2022-05-05 11:30:55,698 [84] [DEBUG] [workers.queueworker] No more work. notificationworker stdout | 2022-05-05 11:30:55,698 [84] [DEBUG] [data.database] Disconnecting from database. notificationworker stdout | 2022-05-05 11:30:55,698 [84] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2022-05-05 11:31:05 UTC)" executed successfully gcworker stdout | 2022-05-05 11:30:58,857 [68] [DEBUG] [apscheduler.scheduler] Looking for jobs to run gcworker stdout | 2022-05-05 11:30:58,858 [68] [DEBUG] [apscheduler.scheduler] Next wakeup is due at 2022-05-05 11:31:28.857216+00:00 (in 29.999238 seconds) gcworker stdout | 2022-05-05 11:30:58,858 [68] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:31:28 UTC)" (scheduled at 2022-05-05 11:30:58.857216+00:00) gcworker stdout | 2022-05-05 11:30:58,859 [68] [DEBUG] [peewee] ('SELECT "candidates"."repository_id" FROM (SELECT DISTINCT "t1"."repository_id" FROM "tag" AS "t1" INNER JOIN "repository" AS "t2" ON ("t1"."repository_id" = "t2"."id") INNER JOIN "user" AS "t3" ON ("t2"."namespace_user_id" = "t3"."id") WHERE ((((NOT ("t1"."lifetime_end_ms" IS %s) AND ("t1"."lifetime_end_ms" <= %s)) AND ("t3"."removed_tag_expiration_s" = %s)) AND ("t3"."enabled" = %s)) AND ("t2"."state" != %s)) LIMIT %s) AS "candidates" ORDER BY Random() LIMIT %s OFFSET %s', [None, 1650540658858, 1209600, True, 3, 500, 1, 0]) gcworker stdout | 2022-05-05 11:30:58,871 [68] [DEBUG] [__main__] No repository with garbage found gcworker stdout | 2022-05-05 11:30:58,871 [68] [DEBUG] [data.database] Disconnecting from database. gcworker stdout | 2022-05-05 11:30:58,871 [68] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2022-05-05 11:31:28 UTC)" executed successfully gunicorn-registry stdout | 2022-05-05 11:31:00,937 [244] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '244'} gunicorn-registry stdout | 2022-05-05 11:31:00,942 [241] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '241'} gunicorn-registry stdout | 2022-05-05 11:31:00,948 [238] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '238'} gunicorn-registry stdout | 2022-05-05 11:31:00,956 [243] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '243'} gunicorn-registry stdout | 2022-05-05 11:31:00,991 [235] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '235'} gunicorn-registry stdout | 2022-05-05 11:31:01,072 [232] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '232'} gunicorn-registry stdout | 2022-05-05 11:31:01,081 [245] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '245'} gunicorn-registry stdout | 2022-05-05 11:31:01,088 [234] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '234'} gunicorn-registry stdout | 2022-05-05 11:31:01,097 [239] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '239'} gunicorn-registry stdout | 2022-05-05 11:31:01,104 [237] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '237'} gunicorn-registry stdout | 2022-05-05 11:31:01,109 [236] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '236'} gunicorn-registry stdout | 2022-05-05 11:31:01,114 [70] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '70'} gunicorn-registry stdout | 2022-05-05 11:31:01,119 [233] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '233'} gunicorn-registry stdout | 2022-05-05 11:31:01,126 [242] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '242'} gunicorn-registry stdout | 2022-05-05 11:31:01,132 [240] [DEBUG] [util.metrics.prometheus] pushed registry to pushgateway at http://localhost:9091 with grouping key {'host': '44104105fec5', 'process_name': 'registry:application', 'pid': '240'}