__ __ / \ / \ ______ _ _ __ __ __ / /\ / /\ \ / __ \ | | | | / \ \ \ / / / / / / \ \ | | | | | | | | / /\ \ \ / \ \ \ \ / / | |__| | | |__| | / ____ \ | | \ \/ \ \/ / \_ ___/ \____/ /_/ \_\ |_| \__/ \__/ \ \__ \___\ by Red Hat Build, Store, and Distribute your Containers Running all default registry services Running init script '/quay-registry/conf/init/certs_create.sh' Running init script '/quay-registry/conf/init/certs_install.sh' Installing extra certificates found in /quay-registry/conf/stack/extra_ca_certs directory Running init script '/quay-registry/conf/init/copy_config_files.sh' Running init script '/quay-registry/conf/init/d_validate_config_bundle.sh' Validating Configuration plpgsql pg_trgm +------------------------+-------------------------------------------+--------+ | Field Group | Error | Status | +------------------------+-------------------------------------------+--------+ | AccessSettings | - | 🟢 | +------------------------+-------------------------------------------+--------+ | ActionLogArchiving | - | 🟢 | +------------------------+-------------------------------------------+--------+ | AppTokenAuthentication | - | 🟢 | +------------------------+-------------------------------------------+--------+ | BitbucketBuildTrigger | - | 🟢 | +------------------------+-------------------------------------------+--------+ | BuildManager | - | 🟢 | +------------------------+-------------------------------------------+--------+ | Database | - | 🟢 | +------------------------+-------------------------------------------+--------+ | DistributedStorage | - | 🟢 | +------------------------+-------------------------------------------+--------+ | ElasticSearch | - | 🟢 | +------------------------+-------------------------------------------+--------+ | Email | - | 🟢 | +------------------------+-------------------------------------------+--------+ | GitHubBuildTrigger | - | 🟢 | +------------------------+-------------------------------------------+--------+ | GitHubLogin | - | 🟢 | +------------------------+-------------------------------------------+--------+ | GitLabBuildTrigger | - | 🟢 | +------------------------+-------------------------------------------+--------+ | GoogleLogin | - | 🟢 | +------------------------+-------------------------------------------+--------+ | HostSettings | - | 🟢 | +------------------------+-------------------------------------------+--------+ | JWTAuthentication | - | 🟢 | +------------------------+-------------------------------------------+--------+ | LDAP | - | 🟢 | +------------------------+-------------------------------------------+--------+ | OIDC | - | 🟢 | +------------------------+-------------------------------------------+--------+ | QuayDocumentation | - | 🟢 | +------------------------+-------------------------------------------+--------+ | Redis | - | 🟢 | +------------------------+-------------------------------------------+--------+ | RepoMirror | - | 🟢 | +------------------------+-------------------------------------------+--------+ | SecurityScanner | dial tcp 10.100.113.138:8089: i/o timeout | 🔴 | +------------------------+-------------------------------------------+--------+ | SigningEngine | - | 🟢 | +------------------------+-------------------------------------------+--------+ | TeamSyncing | - | 🟢 | +------------------------+-------------------------------------------+--------+ | TimeMachine | - | 🟢 | +------------------------+-------------------------------------------+--------+ | UserVisibleSettings | - | 🟢 | +------------------------+-------------------------------------------+--------+ Running init script '/quay-registry/conf/init/nginx_conf_create.sh' Running init script '/quay-registry/conf/init/runmigration.sh' Running init script '/quay-registry/conf/init/supervisord_conf_create.sh' Running init script '/quay-registry/conf/init/zz_boot.sh' 2021-11-08 14:11:22,056 INFO RPC interface 'supervisor' initialized 2021-11-08 14:11:22,056 CRIT Server 'unix_http_server' running without any HTTP authentication checking 2021-11-08 14:11:22,056 INFO supervisord started with pid 7 2021-11-08 14:11:23,059 INFO spawned: 'stdout' with pid 61 2021-11-08 14:11:23,061 INFO spawned: 'blobuploadcleanupworker' with pid 62 2021-11-08 14:11:23,064 INFO spawned: 'builder' with pid 63 2021-11-08 14:11:23,066 INFO spawned: 'buildlogsarchiver' with pid 64 2021-11-08 14:11:23,068 INFO spawned: 'chunkcleanupworker' with pid 65 2021-11-08 14:11:23,071 INFO spawned: 'dnsmasq' with pid 66 2021-11-08 14:11:23,074 INFO spawned: 'expiredappspecifictokenworker' with pid 67 2021-11-08 14:11:23,078 INFO spawned: 'exportactionlogsworker' with pid 68 2021-11-08 14:11:23,081 INFO spawned: 'gcworker' with pid 69 2021-11-08 14:11:23,084 INFO spawned: 'globalpromstats' with pid 70 2021-11-08 14:11:23,087 INFO spawned: 'gunicorn-registry' with pid 71 2021-11-08 14:11:23,101 INFO spawned: 'gunicorn-secscan' with pid 72 2021-11-08 14:11:23,104 INFO spawned: 'gunicorn-web' with pid 73 2021-11-08 14:11:23,107 INFO spawned: 'jwtproxy' with pid 74 2021-11-08 14:11:23,109 INFO spawned: 'logrotateworker' with pid 75 2021-11-08 14:11:23,139 INFO spawned: 'manifestbackfillworker' with pid 76 2021-11-08 14:11:23,142 INFO spawned: 'memcache' with pid 80 2021-11-08 14:11:23,145 INFO spawned: 'namespacegcworker' with pid 81 2021-11-08 14:11:23,148 INFO spawned: 'nginx' with pid 82 2021-11-08 14:11:23,189 INFO spawned: 'notificationworker' with pid 85 2021-11-08 14:11:23,192 INFO spawned: 'pushgateway' with pid 86 2021-11-08 14:11:23,196 INFO spawned: 'queuecleanupworker' with pid 87 2021-11-08 14:11:23,269 INFO spawned: 'repositoryactioncounter' with pid 88 2021-11-08 14:11:23,272 INFO spawned: 'repositorygcworker' with pid 100 2021-11-08 14:11:23,274 INFO spawned: 'securityscanningnotificationworker' with pid 101 2021-11-08 14:11:23,277 INFO spawned: 'securityworker' with pid 102 2021-11-08 14:11:23,354 INFO spawned: 'servicekey' with pid 103 2021-11-08 14:11:23,357 INFO spawned: 'storagereplication' with pid 111 2021-11-08 14:11:23,419 INFO spawned: 'teamsyncworker' with pid 114 2021-11-08 14:11:24,424 INFO success: stdout entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,424 INFO success: blobuploadcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,424 INFO success: builder entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,424 INFO success: buildlogsarchiver entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,424 INFO success: chunkcleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,424 INFO success: dnsmasq entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,424 INFO success: expiredappspecifictokenworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: exportactionlogsworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: gcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: globalpromstats entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: gunicorn-registry entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: gunicorn-secscan entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: gunicorn-web entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: jwtproxy entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: logrotateworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: manifestbackfillworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: memcache entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: namespacegcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: nginx entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: notificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: pushgateway entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: queuecleanupworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: repositoryactioncounter entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: repositorygcworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,425 INFO success: securityscanningnotificationworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,426 INFO success: securityworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,426 INFO success: servicekey entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,426 INFO success: storagereplication entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) 2021-11-08 14:11:24,426 INFO success: teamsyncworker entered RUNNING state, process has stayed up for > than 1 seconds (startsecs) dnsmasq stderr | dnsmasq: started, version 2.79 cachesize 150 dnsmasq stderr | dnsmasq: compile time options: IPv6 GNU-getopt DBus no-i18n IDN2 DHCP DHCPv6 no-Lua TFTP no-conntrack ipset auth DNSSEC loop-detect inotify dnsmasq stderr | dnsmasq: reading /etc/resolv.conf dnsmasq stderr | dnsmasq: using nameserver 10.80.40.1#53 dnsmasq stderr | dnsmasq: using nameserver 10.80.40.2#53 dnsmasq stderr | dnsmasq: read /etc/hosts - 6 addresses jwtproxy stderr | time="2021-11-08T14:11:23Z" level=info msg="No claims verifiers specified, upstream should be configured to verify authorization" jwtproxy stderr | time="2021-11-08T14:11:23Z" level=info msg="Starting reverse proxy (Listening on 'unix:/tmp/jwtproxy_secscan.sock')" jwtproxy stderr | time="2021-11-08T14:11:23Z" level=info msg="Starting forward proxy (Listening on ':8081')" nginx stdout | 2021/11/08 14:11:23 [alert] 105#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2021/11/08 14:11:23 [alert] 106#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2021/11/08 14:11:23 [alert] 107#0: setpriority(-10) failed (13: Permission denied) nginx stdout | 2021/11/08 14:11:23 [alert] 104#0: setpriority(-10) failed (13: Permission denied) pushgateway stderr | level=info ts=2021-11-08T14:11:23.264Z caller=main.go:85 msg="starting pushgateway" version="(version=, branch=, revision=)" pushgateway stderr | level=info ts=2021-11-08T14:11:23.264Z caller=main.go:86 build_context="(go=go1.15.14, user=, date=)" pushgateway stderr | level=info ts=2021-11-08T14:11:23.315Z caller=main.go:139 listen_address=:9091 pushgateway stderr | level=info ts=2021-11-08T14:11:23.315Z caller=tls_config.go:191 msg="TLS is disabled." http2=false repositorygcworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) repositorygcworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) repositorygcworker stderr | Failed to validate security scanner V2 configuration repositorygcworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) repositorygcworker stderr | self._legacy_model = NoopV2SecurityScanner() repositorygcworker stdout | 2021-11-08 14:11:31,058 [100] [INFO] [apscheduler.scheduler] Scheduler started gunicorn-web stdout | 2021-11-08 14:11:31,656 [73] [INFO] [data.registry_model] =============================== gunicorn-web stdout | 2021-11-08 14:11:31,656 [73] [INFO] [data.registry_model] Using registry model `` gunicorn-web stdout | 2021-11-08 14:11:31,657 [73] [INFO] [data.registry_model] =============================== repositorygcworker stdout | 2021-11-08 14:11:31,904 [100] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" repositorygcworker stdout | 2021-11-08 14:11:31,904 [100] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" repositorygcworker stdout | 2021-11-08 14:11:31,904 [100] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" gunicorn-web stdout | 2021-11-08 14:11:33,209 [73] [INFO] [util.ipresolver] Loading AWS IP ranges from disk storagereplication stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) storagereplication stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) storagereplication stderr | Failed to validate security scanner V2 configuration storagereplication stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) storagereplication stderr | self._legacy_model = NoopV2SecurityScanner() expiredappspecifictokenworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) expiredappspecifictokenworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) expiredappspecifictokenworker stderr | Failed to validate security scanner V2 configuration expiredappspecifictokenworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) expiredappspecifictokenworker stderr | self._legacy_model = NoopV2SecurityScanner() expiredappspecifictokenworker stdout | 2021-11-08 14:11:35,885 [67] [INFO] [apscheduler.scheduler] Scheduler started expiredappspecifictokenworker stdout | 2021-11-08 14:11:36,039 [67] [INFO] [apscheduler.scheduler] Added job "ExpiredAppSpecificTokenWorker._gc_expired_tokens" to job store "default" gunicorn-secscan stdout | 2021-11-08 14:11:37,875 [72] [INFO] [data.registry_model] =============================== gunicorn-secscan stdout | 2021-11-08 14:11:37,875 [72] [INFO] [data.registry_model] Using registry model `` gunicorn-secscan stdout | 2021-11-08 14:11:37,876 [72] [INFO] [data.registry_model] =============================== gunicorn-web stdout | 2021-11-08 14:11:39,493 [73] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-web stdout | 2021-11-08 14:11:39,494 [73] [WARNING] [data.secscan_model.secscan_v2_model] Failed to validate security scanner V2 configuration gunicorn-web stdout | 2021-11-08 14:11:39,494 [73] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2021-11-08 14:11:39,494 [73] [INFO] [data.secscan_model] Using split secscan model: `[, ]` gunicorn-web stdout | 2021-11-08 14:11:39,511 [73] [INFO] [data.secscan_model] =============================== gunicorn-web stdout | 2021-11-08 14:11:39,511 [73] [INFO] [data.logs_model] =============================== gunicorn-web stdout | 2021-11-08 14:11:39,511 [73] [INFO] [data.logs_model] Using logs model `` gunicorn-web stdout | 2021-11-08 14:11:39,511 [73] [INFO] [data.logs_model] =============================== gunicorn-web stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-web stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) gunicorn-web stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-web stderr | self._legacy_model = NoopV2SecurityScanner() repositoryactioncounter stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) repositoryactioncounter stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) repositoryactioncounter stderr | Failed to validate security scanner V2 configuration repositoryactioncounter stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) repositoryactioncounter stderr | self._legacy_model = NoopV2SecurityScanner() repositoryactioncounter stdout | 2021-11-08 14:11:40,044 [88] [INFO] [apscheduler.scheduler] Scheduler started gunicorn-secscan stdout | 2021-11-08 14:11:40,156 [72] [INFO] [util.ipresolver] Loading AWS IP ranges from disk securityworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) securityworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) securityworker stderr | Failed to validate security scanner V2 configuration securityworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) securityworker stderr | self._legacy_model = NoopV2SecurityScanner() namespacegcworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) namespacegcworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) namespacegcworker stderr | Failed to validate security scanner V2 configuration namespacegcworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) namespacegcworker stderr | self._legacy_model = NoopV2SecurityScanner() namespacegcworker stdout | 2021-11-08 14:11:40,872 [81] [INFO] [apscheduler.scheduler] Scheduler started repositoryactioncounter stdout | 2021-11-08 14:11:40,927 [88] [INFO] [apscheduler.scheduler] Added job "RepositoryActionCountWorker._run_counting" to job store "default" servicekey stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) servicekey stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) servicekey stderr | Failed to validate security scanner V2 configuration servicekey stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) servicekey stderr | self._legacy_model = NoopV2SecurityScanner() blobuploadcleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) blobuploadcleanupworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) blobuploadcleanupworker stderr | Failed to validate security scanner V2 configuration blobuploadcleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) blobuploadcleanupworker stderr | self._legacy_model = NoopV2SecurityScanner() gcworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gcworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) gcworker stderr | Failed to validate security scanner V2 configuration gcworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gcworker stderr | self._legacy_model = NoopV2SecurityScanner() servicekey stdout | 2021-11-08 14:11:41,116 [103] [INFO] [apscheduler.scheduler] Scheduler started namespacegcworker stdout | 2021-11-08 14:11:41,130 [81] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" namespacegcworker stdout | 2021-11-08 14:11:41,130 [81] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" namespacegcworker stdout | 2021-11-08 14:11:41,130 [81] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" builder stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) builder stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) builder stderr | Failed to validate security scanner V2 configuration builder stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) builder stderr | self._legacy_model = NoopV2SecurityScanner() blobuploadcleanupworker stdout | 2021-11-08 14:11:41,283 [62] [INFO] [apscheduler.scheduler] Scheduler started gcworker stdout | 2021-11-08 14:11:41,573 [69] [INFO] [apscheduler.scheduler] Scheduler started servicekey stdout | 2021-11-08 14:11:41,603 [103] [INFO] [apscheduler.scheduler] Added job "ServiceKeyWorker._refresh_service_key" to job store "default" securityworker stdout | 2021-11-08 14:11:41,756 [102] [INFO] [apscheduler.scheduler] Scheduler started blobuploadcleanupworker stdout | 2021-11-08 14:11:41,895 [62] [INFO] [apscheduler.scheduler] Added job "BlobUploadCleanupWorker._try_cleanup_uploads" to job store "default" logrotateworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) logrotateworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) logrotateworker stderr | Failed to validate security scanner V2 configuration logrotateworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) logrotateworker stderr | self._legacy_model = NoopV2SecurityScanner() notificationworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) notificationworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) notificationworker stderr | Failed to validate security scanner V2 configuration notificationworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) notificationworker stderr | self._legacy_model = NoopV2SecurityScanner() securityworker stdout | 2021-11-08 14:11:41,936 [102] [INFO] [apscheduler.scheduler] Added job "SecurityWorker._index_in_scanner" to job store "default" securityscanningnotificationworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) securityscanningnotificationworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) securityscanningnotificationworker stderr | Failed to validate security scanner V2 configuration securityscanningnotificationworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) securityscanningnotificationworker stderr | self._legacy_model = NoopV2SecurityScanner() logrotateworker stdout | 2021-11-08 14:11:42,060 [75] [INFO] [apscheduler.scheduler] Scheduler started chunkcleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) chunkcleanupworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) chunkcleanupworker stderr | Failed to validate security scanner V2 configuration chunkcleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) chunkcleanupworker stderr | self._legacy_model = NoopV2SecurityScanner() queuecleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) queuecleanupworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) queuecleanupworker stderr | Failed to validate security scanner V2 configuration queuecleanupworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) queuecleanupworker stderr | self._legacy_model = NoopV2SecurityScanner() queuecleanupworker stdout | 2021-11-08 14:11:42,187 [87] [INFO] [apscheduler.scheduler] Scheduler started notificationworker stdout | 2021-11-08 14:11:42,305 [85] [INFO] [apscheduler.scheduler] Scheduler started gcworker stdout | 2021-11-08 14:11:42,334 [69] [INFO] [apscheduler.scheduler] Added job "GarbageCollectionWorker._garbage_collection_repos" to job store "default" logrotateworker stdout | 2021-11-08 14:11:42,341 [75] [INFO] [apscheduler.scheduler] Added job "LogRotateWorker._archive_logs" to job store "default" notificationworker stdout | 2021-11-08 14:11:42,375 [85] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" notificationworker stdout | 2021-11-08 14:11:42,375 [85] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" notificationworker stdout | 2021-11-08 14:11:42,375 [85] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" nginx stdout | 2021/11/08 14:11:42 [crit] 105#0: *29 connect() to unix:/tmp/gunicorn_registry.sock failed (2: No such file or directory) while connecting to upstream, client: 10.100.102.3, server: _, request: "GET /v2/ HTTP/1.1", upstream: "http://unix:/tmp/gunicorn_registry.sock:/v2/", host: "enterprisequay.rblbank.com" gunicorn-web stdout | 2021-11-08 14:11:42,422 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:42 +0000] "GET /quay-registry/static/502.html HTTP/1.0" 308 337 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:42 +0000] "GET /v2/ HTTP/1.1" 502 337 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.028 228 0.000 : 0.027) queuecleanupworker stdout | 2021-11-08 14:11:42,452 [87] [INFO] [apscheduler.scheduler] Added job "QueueCleanupWorker._cleanup_queue" to job store "default" globalpromstats stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) globalpromstats stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) globalpromstats stderr | Failed to validate security scanner V2 configuration globalpromstats stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) globalpromstats stderr | self._legacy_model = NoopV2SecurityScanner() buildlogsarchiver stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) buildlogsarchiver stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) buildlogsarchiver stderr | Failed to validate security scanner V2 configuration buildlogsarchiver stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) buildlogsarchiver stderr | self._legacy_model = NoopV2SecurityScanner() teamsyncworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) teamsyncworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) teamsyncworker stderr | Failed to validate security scanner V2 configuration teamsyncworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) teamsyncworker stderr | self._legacy_model = NoopV2SecurityScanner() buildlogsarchiver stdout | 2021-11-08 14:11:42,792 [64] [INFO] [apscheduler.scheduler] Scheduler started globalpromstats stdout | 2021-11-08 14:11:42,850 [70] [INFO] [apscheduler.scheduler] Scheduler started buildlogsarchiver stdout | 2021-11-08 14:11:42,930 [64] [INFO] [apscheduler.scheduler] Added job "ArchiveBuildLogsWorker._archive_redis_buildlogs" to job store "default" exportactionlogsworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) exportactionlogsworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) exportactionlogsworker stderr | Failed to validate security scanner V2 configuration exportactionlogsworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) exportactionlogsworker stderr | self._legacy_model = NoopV2SecurityScanner() manifestbackfillworker stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) manifestbackfillworker stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) manifestbackfillworker stderr | Failed to validate security scanner V2 configuration manifestbackfillworker stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) manifestbackfillworker stderr | self._legacy_model = NoopV2SecurityScanner() manifestbackfillworker stdout | 2021-11-08 14:11:43,030 [76] [INFO] [apscheduler.scheduler] Scheduler started globalpromstats stdout | 2021-11-08 14:11:43,101 [70] [INFO] [apscheduler.scheduler] Added job "GlobalPrometheusStatsWorker._try_report_stats" to job store "default" gunicorn-secscan stdout | 2021-11-08 14:11:43,106 [72] [INFO] [data.database] Connection pooling disabled for postgresql gunicorn-secscan stdout | 2021-11-08 14:11:43,107 [72] [WARNING] [data.secscan_model.secscan_v2_model] Failed to validate security scanner V2 configuration gunicorn-secscan stdout | 2021-11-08 14:11:43,107 [72] [INFO] [data.secscan_model] =============================== gunicorn-secscan stdout | 2021-11-08 14:11:43,107 [72] [INFO] [data.secscan_model] Using split secscan model: `[, ]` gunicorn-secscan stdout | 2021-11-08 14:11:43,108 [72] [INFO] [data.secscan_model] =============================== gunicorn-secscan stdout | 2021-11-08 14:11:43,108 [72] [INFO] [data.logs_model] =============================== gunicorn-secscan stdout | 2021-11-08 14:11:43,108 [72] [INFO] [data.logs_model] Using logs model `` gunicorn-secscan stdout | 2021-11-08 14:11:43,108 [72] [INFO] [data.logs_model] =============================== gunicorn-secscan stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-secscan stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) gunicorn-secscan stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-secscan stderr | self._legacy_model = NoopV2SecurityScanner() manifestbackfillworker stdout | 2021-11-08 14:11:43,157 [76] [INFO] [apscheduler.scheduler] Added job "ManifestBackfillWorker._backfill_manifests" to job store "default" exportactionlogsworker stdout | 2021-11-08 14:11:43,391 [68] [INFO] [apscheduler.scheduler] Scheduler started exportactionlogsworker stdout | 2021-11-08 14:11:43,437 [68] [INFO] [apscheduler.scheduler] Added job "QueueWorker.poll_queue" to job store "default" exportactionlogsworker stdout | 2021-11-08 14:11:43,438 [68] [INFO] [apscheduler.scheduler] Added job "QueueWorker.update_queue_metrics" to job store "default" exportactionlogsworker stdout | 2021-11-08 14:11:43,438 [68] [INFO] [apscheduler.scheduler] Added job "QueueWorker.run_watchdog" to job store "default" gunicorn-registry stdout | 2021-11-08 14:11:43,624 [71] [INFO] [data.registry_model] =============================== gunicorn-registry stdout | 2021-11-08 14:11:43,624 [71] [INFO] [data.registry_model] Using registry model `` gunicorn-registry stdout | 2021-11-08 14:11:43,624 [71] [INFO] [data.registry_model] =============================== gunicorn-registry stdout | 2021-11-08 14:11:43,918 [71] [INFO] [util.ipresolver] Loading AWS IP ranges from disk gunicorn-registry stdout | 2021-11-08 14:11:44,957 [71] [INFO] [data.database] Connection pooling enabled for postgresql; stale timeout: None; max connection count: None gunicorn-registry stdout | 2021-11-08 14:11:44,958 [71] [WARNING] [data.secscan_model.secscan_v2_model] Failed to validate security scanner V2 configuration gunicorn-registry stdout | 2021-11-08 14:11:44,958 [71] [INFO] [data.secscan_model] =============================== gunicorn-registry stderr | /quay-registry/data/secscan_model/__init__.py:28: DeprecationWarning: Call to deprecated class V2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-registry stderr | self._legacy_model = V2SecurityScanner(app, instance_keys, storage) gunicorn-registry stderr | /quay-registry/data/secscan_model/__init__.py:30: DeprecationWarning: Call to deprecated class NoopV2SecurityScanner. (Will be replaced by a V4 API security scanner soon) gunicorn-registry stderr | self._legacy_model = NoopV2SecurityScanner() gunicorn-registry stdout | 2021-11-08 14:11:44,958 [71] [INFO] [data.secscan_model] Using split secscan model: `[, ]` gunicorn-registry stdout | 2021-11-08 14:11:44,958 [71] [INFO] [data.secscan_model] =============================== gunicorn-registry stdout | 2021-11-08 14:11:44,958 [71] [INFO] [data.logs_model] =============================== gunicorn-registry stdout | 2021-11-08 14:11:44,958 [71] [INFO] [data.logs_model] Using logs model `` gunicorn-registry stdout | 2021-11-08 14:11:44,958 [71] [INFO] [data.logs_model] =============================== gunicorn-web stdout | 2021-11-08 14:11:46,986 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:46 +0000] "GET / HTTP/1.0" 200 81214 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:46 +0000] "GET / HTTP/2.0" 200 12916 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.086 442 0.085) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:47 +0000] "GET /static/build/main-quay-frontend-3258d1be324353a8e49b.bundle.js HTTP/2.0" 200 706568 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.032 243 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:47 +0000] "GET /static/build/83-quay-frontend.chunk.js HTTP/2.0" 200 1705 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.000 46 -) securityworker stdout | 2021-11-08 14:11:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:11:47 UTC)" (scheduled at 2021-11-08 14:11:47.787050+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:47 +0000] "GET /static/build/135-quay-frontend.chunk.js HTTP/2.0" 200 962 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.000 46 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:47 +0000] "GET /static/build/18-quay-frontend.chunk.js HTTP/2.0" 200 985 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.000 45 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:47 +0000] "GET /static/build/112-quay-frontend.chunk.js HTTP/2.0" 200 755 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.000 46 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:47 +0000] "GET /static/build/181-quay-frontend.chunk.js HTTP/2.0" 200 939 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.000 46 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:47 +0000] "GET /static/build/152-quay-frontend.chunk.js HTTP/2.0" 200 313 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.000 46 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:48 +0000] "GET /api/v1/user/ HTTP/2.0" 401 254 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.016 154 0.016) gunicorn-web stdout | 2021-11-08 14:11:48,019 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:48 +0000] "GET /api/v1/user/ HTTP/1.0" 401 254 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:11:48,065 [219] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/api/v1/messages', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:48 +0000] "GET /api/v1/messages HTTP/2.0" 401 47 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.018 174 0.017) gunicorn-web stdout | 2021-11-08 14:11:48,071 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:48 +0000] "GET /api/v1/messages HTTP/1.0" 401 47 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:11:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:11:50 UTC)" (scheduled at 2021-11-08 14:11:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:11:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:11:50 UTC)" (scheduled at 2021-11-08 14:11:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:11:51,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:12:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:11:51,421 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:00 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:51 +0000] "POST /api/v1/signin HTTP/2.0" 200 18 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.391 134 1.391) gunicorn-web stdout | 2021-11-08 14:11:51,787 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:51 +0000] "POST /api/v1/signin HTTP/1.0" 200 18 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" buildlogsarchiver stdout | 2021-11-08 14:11:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:11:51 UTC)" (scheduled at 2021-11-08 14:11:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:11:51,851 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:12:21 UTC)" executed successfully securityworker stdout | 2021-11-08 14:11:52,051 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 14:11:52,065 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 447-464 securityworker stdout | 2021-11-08 14:11:52,178 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/user/ HTTP/2.0" 200 1442 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.385 426 0.385) gunicorn-web stdout | 2021-11-08 14:11:52,184 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/user/ HTTP/1.0" 200 1442 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:11:52,219 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 14:11:52,223 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 152-192 securityworker stdout | 2021-11-08 14:11:52,226 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 192-232 securityworker stdout | 2021-11-08 14:11:52,229 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:11:52,232 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 14:11:52,234 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 14:11:52,239 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 21-61 securityworker stdout | 2021-11-08 14:11:52,242 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:11:52,245 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 14:11:52,247 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:11:52,248 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 14:11:52,250 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 14:11:52,251 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:11:52,253 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:11:52,256 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 14:11:52,258 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 32-72 securityworker stdout | 2021-11-08 14:11:52,261 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:11:52,265 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 14:11:52,267 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 14:11:52,269 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:11:52,271 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.075 396 0.075) gunicorn-web stdout | 2021-11-08 14:11:52,272 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:11:52,273 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.077 46 0.077) gunicorn-web stdout | 2021-11-08 14:11:52,274 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:11:52,276 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 14:11:52,279 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:11:52,282 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 14:11:52,284 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:11:52,290 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:11:52,292 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:11:52,295 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 14:11:52,297 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 14:11:52,297 [102] [INFO] [util.migrate.allocator] No more work gcworker stdout | 2021-11-08 14:11:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:11:52 UTC)" (scheduled at 2021-11-08 14:11:52.617060+00:00) gunicorn-web stdout | 2021-11-08 14:11:52,768 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:11:52,768 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.408 111 0.408) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.408 90 0.408) gunicorn-web stdout | 2021-11-08 14:11:52,793 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.433 68 0.433) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.451 91 0.451) gunicorn-web stdout | 2021-11-08 14:11:52,812 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gcworker stdout | 2021-11-08 14:11:52,823 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:12:22 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.600 88 0.600) gunicorn-web stdout | 2021-11-08 14:11:52,960 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:52 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:11:52,995 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block repositorygcworker stdout | 2021-11-08 14:11:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:11:54 UTC)" (scheduled at 2021-11-08 14:11:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:11:54,230 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:12:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:11:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:11:55 UTC)" (scheduled at 2021-11-08 14:11:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:11:55,133 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:11:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:56 +0000] "GET /api/v1/organization/finacle10225 HTTP/2.0" 200 1000 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.336 87 0.336) gunicorn-web stdout | 2021-11-08 14:11:56,659 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:56 +0000] "GET /api/v1/organization/finacle10225 HTTP/1.0" 200 1000 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:57 +0000] "GET /api/v1/organization/finacle10225/prototypes HTTP/2.0" 200 19 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.197 421 0.197) gunicorn-web stdout | 2021-11-08 14:11:57,160 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:57 +0000] "GET /api/v1/organization/finacle10225/prototypes HTTP/1.0" 200 19 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:11:57 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.282 84 0.282) gunicorn-web stdout | 2021-11-08 14:11:57,280 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:11:57 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.385 414 0.385) gunicorn-web stdout | 2021-11-08 14:12:00,058 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:00,178 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:00,178 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:00,179 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.469 91 0.469) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.469 89 0.469) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.468 92 0.468) gunicorn-web stdout | 2021-11-08 14:12:00,182 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:00 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.506 290 0.506) notificationworker stdout | 2021-11-08 14:12:00,325 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:10 UTC)" (scheduled at 2021-11-08 14:12:00.322052+00:00) notificationworker stdout | 2021-11-08 14:12:00,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:03 +0000] "GET /v1/_ping HTTP/1.1" 200 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.000 233 -) gunicorn-web stdout | 2021-11-08 14:12:03,898 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:03 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch?includeStats=true&includeTags=false HTTP/1.0" 200 3642 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:03 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch?includeStats=true&includeTags=false HTTP/2.0" 200 3642 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.333 127 0.334) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:04 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.106 468 0.105) gunicorn-web stdout | 2021-11-08 14:12:04,632 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:04 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:04,771 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:04 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:04 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.207 512 1.207) exportactionlogsworker stdout | 2021-11-08 14:12:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:06 UTC)" (scheduled at 2021-11-08 14:12:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:12:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:12:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:09 UTC)" (scheduled at 2021-11-08 14:12:09.376681+00:00) notificationworker stdout | 2021-11-08 14:12:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:12:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:20 UTC)" (scheduled at 2021-11-08 14:12:10.322052+00:00) notificationworker stdout | 2021-11-08 14:12:10,943 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:12 +0000] "GET /v1/_ping HTTP/1.1" 200 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.000 233 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:15 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.008 228 0.008) gunicorn-registry stdout | 2021-11-08 14:12:15,433 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:15 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:12:15,459 [242] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:15 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.005 272 0.005) gunicorn-registry stdout | 2021-11-08 14:12:15,462 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:15 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 14:12:16,907 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:16 UTC)" (scheduled at 2021-11-08 14:12:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:12:16,907 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:12:17,789 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:12:17 UTC)" skipped: maximum number of running instances reached (1) notificationworker stdout | 2021-11-08 14:12:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:30 UTC)" (scheduled at 2021-11-08 14:12:20.322052+00:00) notificationworker stdout | 2021-11-08 14:12:21,183 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:12:21,797 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:12:51 UTC)" (scheduled at 2021-11-08 14:12:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:12:22,272 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:12:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:12:22,619 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:12:52 UTC)" (scheduled at 2021-11-08 14:12:22.617060+00:00) gcworker stdout | 2021-11-08 14:12:23,539 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:12:52 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:12:23,828 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:23 +0000] "GET /repository/finacle10225/fincore_finbranch?tab=tags HTTP/1.0" 200 81214 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:23 +0000] "GET /repository/finacle10225/fincore_finbranch?tab=tags HTTP/2.0" 200 12916 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.054 218 0.054) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:23 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:8f15766b20492abc29824da671f2583b26005f51cc4d0085a63e4f8be99a54c4/security?vulnerabilities=true HTTP/2.0" 499 0 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (17.624 148 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:23 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:ccc5d391ef8356916acbbb678f030c0c1a711b2af925d8074a9072e0914ed59d/security?vulnerabilities=true HTTP/2.0" 499 0 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (17.624 133 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:23 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:5ad4edc9e8d289df12956d2e99f50a70404404942b7b014a599f0e785d4552b5/security?vulnerabilities=true HTTP/2.0" 499 0 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (17.624 601 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:23 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:493e6260308491ea7bc4b59e9b784145264b4dccb25293f0c5e5000040e3cbce/security?vulnerabilities=true HTTP/2.0" 499 0 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (17.625 133 -) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/messages HTTP/2.0" 200 17 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.280 32 0.280) gunicorn-web stdout | 2021-11-08 14:12:24,778 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/user/ HTTP/2.0" 200 1442 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.333 377 0.333) gunicorn-web stdout | 2021-11-08 14:12:24,802 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/user/ HTTP/1.0" 200 1442 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.018 70 0.018) gunicorn-web stdout | 2021-11-08 14:12:24,832 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.079 383 0.079) gunicorn-web stdout | 2021-11-08 14:12:24,893 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch?includeStats=true&includeTags=false HTTP/2.0" 200 3642 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.327 81 0.327) gunicorn-web stdout | 2021-11-08 14:12:24,918 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:24 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch?includeStats=true&includeTags=false HTTP/1.0" 200 3642 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:25,008 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:25 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:25 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.420 86 0.420) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:25 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.247 67 0.247) gunicorn-web stdout | 2021-11-08 14:12:25,954 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:25 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:12:27,887 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:27 UTC)" (scheduled at 2021-11-08 14:12:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:12:29,266 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:12:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:40 UTC)" (scheduled at 2021-11-08 14:12:30.322052+00:00) securityworker stdout | 2021-11-08 14:12:30,768 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:12:30,769 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:12:30,770 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:12:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:12:32,032 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.511 103 0.510) gunicorn-web stdout | 2021-11-08 14:12:35,255 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.639 92 0.639) gunicorn-web stdout | 2021-11-08 14:12:35,390 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:35,404 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.659 78 0.659) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.671 89 0.671) gunicorn-web stdout | 2021-11-08 14:12:35,418 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:35,458 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:35 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.712 91 0.712) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:37 +0000] "GET /api/v1/organization/demoorg HTTP/2.0" 200 662 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.032 425 0.032) gunicorn-web stdout | 2021-11-08 14:12:37,185 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:37 +0000] "GET /api/v1/organization/demoorg HTTP/1.0" 200 662 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:37,586 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:37 +0000] "GET /api/v1/organization/demoorg/prototypes HTTP/1.0" 200 19 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:37 +0000] "GET /api/v1/organization/demoorg/prototypes HTTP/2.0" 200 19 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.060 475 0.059) gunicorn-web stdout | 2021-11-08 14:12:37,853 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:37 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:37 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.293 142 0.293) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:39 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 461 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.343 139 0.343) gunicorn-web stdout | 2021-11-08 14:12:39,751 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:39 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 461 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror?includeStats=true&includeTags=false HTTP/2.0" 200 3637 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.660 73 0.660) gunicorn-web stdout | 2021-11-08 14:12:40,068 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror?includeStats=true&includeTags=false HTTP/1.0" 200 3637 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:12:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:50 UTC)" (scheduled at 2021-11-08 14:12:40.322052+00:00) notificationworker stdout | 2021-11-08 14:12:40,373 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:12:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/2.0" 200 537 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.214 397 0.213) gunicorn-web stdout | 2021-11-08 14:12:40,477 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/1.0" 200 537 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:40 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.007 228 0.007) gunicorn-registry stdout | 2021-11-08 14:12:40,503 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:40 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.077 59 0.077) gunicorn-web stdout | 2021-11-08 14:12:40,545 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-registry stdout | 2021-11-08 14:12:40,745 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:12:40 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:12:40 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.221 325 0.221) gunicorn-registry stdout | 2021-11-08 14:12:41,385 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:41 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:41 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.612 1690 0.612) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:42 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:dab5c03832c877dbb47f91a036c9a6fd21d80726deadce540db769800d395266 HTTP/2.0" 200 1638 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.329 159 0.329) gunicorn-web stdout | 2021-11-08 14:12:42,578 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:42 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:dab5c03832c877dbb47f91a036c9a6fd21d80726deadce540db769800d395266 HTTP/1.0" 200 1638 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:45 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:dab5c03832c877dbb47f91a036c9a6fd21d80726deadce540db769800d395266/labels HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.706 110 0.706) gunicorn-web stdout | 2021-11-08 14:12:45,917 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:45 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:dab5c03832c877dbb47f91a036c9a6fd21d80726deadce540db769800d395266/labels HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:12:46,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:17:46 UTC)" (scheduled at 2021-11-08 14:12:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:12:46,498 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:17:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:12:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:17 UTC)" (scheduled at 2021-11-08 14:12:47.787050+00:00) securityworker stdout | 2021-11-08 14:12:47,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:12:47,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 14:12:47,928 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 14:12:47,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 152-192 securityworker stdout | 2021-11-08 14:12:47,932 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 14:12:47,961 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 381-421 securityworker stdout | 2021-11-08 14:12:47,963 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 23-63 securityworker stdout | 2021-11-08 14:12:47,965 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:12:47,968 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:12:47,970 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 14:12:47,973 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 14:12:47,975 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 14:12:47,977 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 14:12:47,979 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:12:47,982 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:12:47,983 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:12:47,985 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:12:47,985 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:12:48,038 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 360-400 securityworker stdout | 2021-11-08 14:12:48,042 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:12:48,046 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 14:12:48,049 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:12:48,051 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 14:12:48,054 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:12:48,056 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 14:12:48,058 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 14:12:48,060 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 263-303 securityworker stdout | 2021-11-08 14:12:48,062 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:12:48,064 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 14:12:48,067 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 14:12:48,069 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:12:48,071 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:12:48,073 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:12:48,075 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 14:12:48,078 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:12:48,080 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:12:48,080 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:12:48,272 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:12:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:00 UTC)" (scheduled at 2021-11-08 14:12:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:12:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:50 UTC)" (scheduled at 2021-11-08 14:12:50.393684+00:00) notificationworker stdout | 2021-11-08 14:12:50,440 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:12:50,448 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:50 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.076 414 0.076) gunicorn-web stdout | 2021-11-08 14:12:50,542 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:50 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.770 101 0.770) gunicorn-web stdout | 2021-11-08 14:12:51,236 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:12:51,307 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.840 92 0.840) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.876 89 0.876) gunicorn-web stdout | 2021-11-08 14:12:51,342 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.916 91 0.916) gunicorn-web stdout | 2021-11-08 14:12:51,382 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" buildlogsarchiver stdout | 2021-11-08 14:12:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:21 UTC)" (scheduled at 2021-11-08 14:12:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:12:51,830 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:12:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:17:52 UTC)" (scheduled at 2021-11-08 14:12:52.376404+00:00) notificationworker stdout | 2021-11-08 14:12:52,413 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:17:52 UTC)" executed successfully gcworker stdout | 2021-11-08 14:12:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:22 UTC)" (scheduled at 2021-11-08 14:12:52.617060+00:00) gcworker stdout | 2021-11-08 14:12:52,674 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:12:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:54 UTC)" (scheduled at 2021-11-08 14:12:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:12:54,370 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:12:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:55 UTC)" (scheduled at 2021-11-08 14:12:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:12:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:13:55 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:12:55,980 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:55 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:ccc5d391ef8356916acbbb678f030c0c1a711b2af925d8074a9072e0914ed59d/security?vulnerabilities=true HTTP/1.0" 200 27583 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:55 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:ccc5d391ef8356916acbbb678f030c0c1a711b2af925d8074a9072e0914ed59d/security?vulnerabilities=true HTTP/2.0" 200 27583 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.395 133 30.395) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:55 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:5ad4edc9e8d289df12956d2e99f50a70404404942b7b014a599f0e785d4552b5/security?vulnerabilities=true HTTP/2.0" 200 27579 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.413 478 30.413) gunicorn-web stdout | 2021-11-08 14:12:55,998 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:55 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:5ad4edc9e8d289df12956d2e99f50a70404404942b7b014a599f0e785d4552b5/security?vulnerabilities=true HTTP/1.0" 200 27579 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:8f15766b20492abc29824da671f2583b26005f51cc4d0085a63e4f8be99a54c4/security?vulnerabilities=true HTTP/2.0" 200 27579 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.488 372 30.488) gunicorn-web stdout | 2021-11-08 14:12:56,073 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:8f15766b20492abc29824da671f2583b26005f51cc4d0085a63e4f8be99a54c4/security?vulnerabilities=true HTTP/1.0" 200 27579 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:493e6260308491ea7bc4b59e9b784145264b4dccb25293f0c5e5000040e3cbce/security?vulnerabilities=true HTTP/2.0" 200 27583 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.490 133 30.490) gunicorn-web stdout | 2021-11-08 14:12:56,075 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:493e6260308491ea7bc4b59e9b784145264b4dccb25293f0c5e5000040e3cbce/security?vulnerabilities=true HTTP/1.0" 200 27583 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:56 +0000] "GET /api/v1/users/13038 HTTP/2.0" 200 1442 "https://enterprisequay.rblbank.com/user/13038" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.463 414 0.463) gunicorn-web stdout | 2021-11-08 14:12:56,466 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:56 +0000] "GET /api/v1/users/13038 HTTP/1.0" 200 1442 "https://enterprisequay.rblbank.com/user/13038" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:56 +0000] "GET /api/v1/user/apptoken HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/user/13038" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.025 619 0.025) gunicorn-web stdout | 2021-11-08 14:12:56,642 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:56 +0000] "GET /api/v1/user/apptoken HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/user/13038" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:12:57 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&public=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/user/13038" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.274 181 0.274) gunicorn-web stdout | 2021-11-08 14:12:57,056 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:12:57 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&public=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/user/13038" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:13:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:10 UTC)" (scheduled at 2021-11-08 14:13:00.322052+00:00) notificationworker stdout | 2021-11-08 14:13:01,016 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:01 +0000] "GET /api/v1/repository/13038/sample-redis/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 2148 "https://enterprisequay.rblbank.com/repository/13038/sample-redis" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.523 469 1.523) gunicorn-web stdout | 2021-11-08 14:13:01,090 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:01 +0000] "GET /api/v1/repository/13038/sample-redis/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 2148 "https://enterprisequay.rblbank.com/repository/13038/sample-redis" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:01 +0000] "GET /api/v1/repository/13038/sample-redis?includeStats=true&includeTags=false HTTP/2.0" 200 3630 "https://enterprisequay.rblbank.com/repository/13038/sample-redis" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.588 148 1.588) gunicorn-web stdout | 2021-11-08 14:13:01,156 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:01 +0000] "GET /api/v1/repository/13038/sample-redis?includeStats=true&includeTags=false HTTP/1.0" 200 3630 "https://enterprisequay.rblbank.com/repository/13038/sample-redis" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:13:01,356 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:13:01,357 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:13:01,358 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:17 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:01 +0000] "GET /api/v1/repository/13038/sample-redis/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/13038/sample-redis" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.064 403 0.064) gunicorn-web stdout | 2021-11-08 14:13:01,626 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:01 +0000] "GET /api/v1/repository/13038/sample-redis/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/13038/sample-redis" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" exportactionlogsworker stdout | 2021-11-08 14:13:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:06 UTC)" (scheduled at 2021-11-08 14:13:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:13:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:13:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:09 UTC)" (scheduled at 2021-11-08 14:13:09.376681+00:00) notificationworker stdout | 2021-11-08 14:13:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:13:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:20 UTC)" (scheduled at 2021-11-08 14:13:10.322052+00:00) notificationworker stdout | 2021-11-08 14:13:11,296 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:13:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:18:14 UTC)" (scheduled at 2021-11-08 14:13:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:13:15,345 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:18:14 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:13:15,616 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:15 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647/security?vulnerabilities=true HTTP/1.0" 200 34731 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:15 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647/security?vulnerabilities=true HTTP/2.0" 200 34731 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.408 126 30.408) gunicorn-web stdout | 2021-11-08 14:13:15,658 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:15 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:2251147327b667388a2b9ba175fee4d44e541dbdfa1b7f9c1161f1511b8ca3e5/security?vulnerabilities=true HTTP/1.0" 200 34945 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:15 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:2251147327b667388a2b9ba175fee4d44e541dbdfa1b7f9c1161f1511b8ca3e5/security?vulnerabilities=true HTTP/2.0" 200 34945 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.452 470 30.452) gunicorn-web stdout | 2021-11-08 14:13:15,981 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:15 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:072eb8636ab29d31123c1ce3b862ad33ef3d73628fc23b3e91e25934ec97aea2/security?vulnerabilities=true HTTP/1.0" 200 34533 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:15 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:072eb8636ab29d31123c1ce3b862ad33ef3d73628fc23b3e91e25934ec97aea2/security?vulnerabilities=true HTTP/2.0" 200 34533 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.773 125 30.773) repositorygcworker stdout | 2021-11-08 14:13:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:16 UTC)" (scheduled at 2021-11-08 14:13:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:13:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:13:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:47 UTC)" (scheduled at 2021-11-08 14:13:17.787050+00:00) securityworker stdout | 2021-11-08 14:13:17,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 14:13:17,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 14:13:17,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 14:13:18,130 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 14:13:18,134 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 179-219 securityworker stdout | 2021-11-08 14:13:18,137 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:13:18,140 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 10-50 securityworker stdout | 2021-11-08 14:13:18,142 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:13:18,145 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 14:13:18,147 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 14:13:18,149 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 353-393 securityworker stdout | 2021-11-08 14:13:18,151 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 14:13:18,153 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 300-340 securityworker stdout | 2021-11-08 14:13:18,155 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 340-380 securityworker stdout | 2021-11-08 14:13:18,157 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 14:13:18,159 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 219-259 securityworker stdout | 2021-11-08 14:13:18,162 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 451-464 securityworker stdout | 2021-11-08 14:13:18,162 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:13:18,202 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 14:13:18,206 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:13:18,208 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:13:18,210 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:13:18,212 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 14:13:18,215 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 14:13:18,217 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 14:13:18,219 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 14:13:18,221 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 14:13:18,224 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:13:18,226 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 14:13:18,229 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 14:13:18,231 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:13:18,233 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 14:13:18,235 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 444-464 securityworker stdout | 2021-11-08 14:13:18,237 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:13:18,237 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:13:18,782 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:13:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:30 UTC)" (scheduled at 2021-11-08 14:13:20.322052+00:00) notificationworker stdout | 2021-11-08 14:13:20,619 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:13:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:51 UTC)" (scheduled at 2021-11-08 14:13:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:13:22,149 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:13:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:52 UTC)" (scheduled at 2021-11-08 14:13:22.617060+00:00) gcworker stdout | 2021-11-08 14:13:22,756 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:13:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:27 UTC)" (scheduled at 2021-11-08 14:13:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:13:28,754 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:13:30,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:40 UTC)" (scheduled at 2021-11-08 14:13:30.322052+00:00) notificationworker stdout | 2021-11-08 14:13:30,658 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:13:31,276 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:13:31,276 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:13:31,277 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:13:47 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:33 +0000] "GET /api/v1/repository/13038/sample-redis/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.845 404 0.845) gunicorn-web stdout | 2021-11-08 14:13:33,738 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:33 +0000] "GET /api/v1/repository/13038/sample-redis/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:13:33,869 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:33 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:0f44e34ba9a2eec62ccc1da4afd2151fb8c5e2507568a8879b10b023d6cfc487/security?vulnerabilities=true HTTP/1.0" 200 27351 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:33 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:0f44e34ba9a2eec62ccc1da4afd2151fb8c5e2507568a8879b10b023d6cfc487/security?vulnerabilities=true HTTP/2.0" 200 27351 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.489 178 30.489) gunicorn-web stdout | 2021-11-08 14:13:33,944 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:33 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:3814e22a7cfb3a9003791200486cc1c57753ddab80f0a40f1178b30ddfaaec84/security?vulnerabilities=true HTTP/1.0" 200 46914 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:33 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:3814e22a7cfb3a9003791200486cc1c57753ddab80f0a40f1178b30ddfaaec84/security?vulnerabilities=true HTTP/2.0" 200 46914 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.566 125 30.566) gunicorn-web stdout | 2021-11-08 14:13:33,974 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:33 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:03493a5bbb6561d1804fc1bec5eb1c9de428fa3f3b747307194f8db492b8132b/security?vulnerabilities=true HTTP/1.0" 200 61110 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:33 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:03493a5bbb6561d1804fc1bec5eb1c9de428fa3f3b747307194f8db492b8132b/security?vulnerabilities=true HTTP/2.0" 200 61110 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.594 126 30.594) notificationworker stdout | 2021-11-08 14:13:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:50 UTC)" (scheduled at 2021-11-08 14:13:40.322052+00:00) notificationworker stdout | 2021-11-08 14:13:40,832 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:13:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:13:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:17 UTC)" (scheduled at 2021-11-08 14:13:47.787050+00:00) securityworker stdout | 2021-11-08 14:13:48,543 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 14:13:48,546 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 430-464 securityworker stdout | 2021-11-08 14:13:48,581 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 14:13:48,585 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 215-255 securityworker stdout | 2021-11-08 14:13:48,588 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 14:13:48,591 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 14:13:48,594 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 161-201 securityworker stdout | 2021-11-08 14:13:48,596 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:13:48,599 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 14:13:48,602 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:13:48,605 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:13:48,608 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:13:48,742 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 14:13:48,746 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 14:13:48,749 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 14:13:48,751 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 379-419 securityworker stdout | 2021-11-08 14:13:48,753 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 14:13:48,753 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:13:48,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 14:13:48,926 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 14:13:48,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 14:13:48,934 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 14:13:48,936 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 14:13:48,938 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 14:13:48,941 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 15-55 securityworker stdout | 2021-11-08 14:13:48,944 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 14:13:48,948 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 14:13:48,952 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 14:13:48,954 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 272-312 securityworker stdout | 2021-11-08 14:13:48,956 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 312-352 securityworker stdout | 2021-11-08 14:13:48,960 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 14:13:48,962 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 379-419 securityworker stdout | 2021-11-08 14:13:48,965 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 14:13:48,968 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:13:48,970 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 14:13:48,974 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:13:48,977 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:13:48,977 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:13:49,363 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:13:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:00 UTC)" (scheduled at 2021-11-08 14:13:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:13:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:50 UTC)" (scheduled at 2021-11-08 14:13:50.393684+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:50 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:13:50,612 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:50 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:13:50,632 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:13:50,719 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:13:50,739 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:13:50 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:13:50 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.106 325 0.106) buildlogsarchiver stdout | 2021-11-08 14:13:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:21 UTC)" (scheduled at 2021-11-08 14:13:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:13:52,043 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:21 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:52 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (1.500 1690 1.500) gunicorn-registry stdout | 2021-11-08 14:13:52,264 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:52 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gcworker stdout | 2021-11-08 14:13:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:22 UTC)" (scheduled at 2021-11-08 14:13:52.617060+00:00) gcworker stdout | 2021-11-08 14:13:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:13:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:54 UTC)" (scheduled at 2021-11-08 14:13:54.169080+00:00) namespacegcworker stdout | 2021-11-08 14:13:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:55 UTC)" (scheduled at 2021-11-08 14:13:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:13:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:55 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:13:55,295 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:14:54 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:13:55,564 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:55 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:3814e22a7cfb3a9003791200486cc1c57753ddab80f0a40f1178b30ddfaaec84/security?vulnerabilities=true HTTP/1.0" 200 46914 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:55 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:3814e22a7cfb3a9003791200486cc1c57753ddab80f0a40f1178b30ddfaaec84/security?vulnerabilities=true HTTP/2.0" 200 46914 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (32.176 125 32.176) gunicorn-web stdout | 2021-11-08 14:13:55,694 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:55 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:3814e22a7cfb3a9003791200486cc1c57753ddab80f0a40f1178b30ddfaaec84/security?vulnerabilities=true HTTP/1.0" 200 46914 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:55 +0000] "GET /api/v1/repository/13038/sample-redis/manifest/sha256:3814e22a7cfb3a9003791200486cc1c57753ddab80f0a40f1178b30ddfaaec84/security?vulnerabilities=true HTTP/2.0" 200 46914 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (32.307 125 32.307) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:55 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 14:13:55,937 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:55 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:13:56,123 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:13:56 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:13:56 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.161 325 0.161) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:13:56 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.757 1689 0.755) gunicorn-registry stdout | 2021-11-08 14:13:56,908 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:13:56 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:14:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:10 UTC)" (scheduled at 2021-11-08 14:14:00.322052+00:00) securityworker stdout | 2021-11-08 14:14:00,525 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:14:00,525 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:14:00,526 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:14:01,533 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:14:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:06 UTC)" (scheduled at 2021-11-08 14:14:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:14:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:14:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:09 UTC)" (scheduled at 2021-11-08 14:14:09.376681+00:00) notificationworker stdout | 2021-11-08 14:14:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:14:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:20 UTC)" (scheduled at 2021-11-08 14:14:10.322052+00:00) notificationworker stdout | 2021-11-08 14:14:13,294 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:14:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:16 UTC)" (scheduled at 2021-11-08 14:14:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:14:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:14:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:47 UTC)" (scheduled at 2021-11-08 14:14:17.787050+00:00) securityworker stdout | 2021-11-08 14:14:19,979 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:14:20,191 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:14:20,195 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 14:14:20,198 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 39-79 securityworker stdout | 2021-11-08 14:14:20,201 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:14:20,204 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 14:14:20,206 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 14:14:20,208 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 14:14:20,210 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 14:14:20,213 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:14:20,319 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 358-398 securityworker stdout | 2021-11-08 14:14:20,322 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 398-438 notificationworker stdout | 2021-11-08 14:14:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:30 UTC)" (scheduled at 2021-11-08 14:14:20.322052+00:00) securityworker stdout | 2021-11-08 14:14:20,325 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 14:14:20,327 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 14:14:20,383 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:14:20,386 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:14:20,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 14:14:20,892 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:14:20,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:14:20,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 26-66 securityworker stdout | 2021-11-08 14:14:20,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:14:20,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:14:20,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 186-226 securityworker stdout | 2021-11-08 14:14:20,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:14:20,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 14:14:20,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 14:14:20,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:14:20,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:14:20,928 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 362-402 securityworker stdout | 2021-11-08 14:14:20,931 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 14:14:20,934 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 353-393 securityworker stdout | 2021-11-08 14:14:20,937 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 14:14:20,940 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:14:20,942 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 14:14:20,945 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 14:14:20,945 [102] [INFO] [util.migrate.allocator] No more work notificationworker stdout | 2021-11-08 14:14:21,134 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:14:21,506 [102] [INFO] [util.migrate.allocator] Found 39 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:14:21 +0000] "GET /api/v1/repository/13038/sample-redis/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (3.730 403 3.730) gunicorn-web stdout | 2021-11-08 14:14:21,513 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:14:21 +0000] "GET /api/v1/repository/13038/sample-redis/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" buildlogsarchiver stdout | 2021-11-08 14:14:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:51 UTC)" (scheduled at 2021-11-08 14:14:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:14:21,809 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:14:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:52 UTC)" (scheduled at 2021-11-08 14:14:22.617060+00:00) gcworker stdout | 2021-11-08 14:14:23,867 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:14:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:27 UTC)" (scheduled at 2021-11-08 14:14:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:14:28,446 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:27 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:14:29 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.006 228 0.006) gunicorn-registry stdout | 2021-11-08 14:14:29,282 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:14:29 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:14:29 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.696 325 0.696) gunicorn-registry stdout | 2021-11-08 14:14:29,998 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:14:29 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:14:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:40 UTC)" (scheduled at 2021-11-08 14:14:30.322052+00:00) notificationworker stdout | 2021-11-08 14:14:30,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:14:31 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (1.431 1690 1.431) gunicorn-registry stdout | 2021-11-08 14:14:31,449 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:14:31 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:14:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:50 UTC)" (scheduled at 2021-11-08 14:14:40.322052+00:00) notificationworker stdout | 2021-11-08 14:14:40,390 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:14:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:14:46,502 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:14:46 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:14:46 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:14:46,657 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:14:46 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:14:46 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.134 325 0.134) securityworker stdout | 2021-11-08 14:14:47,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:14:47 UTC)" skipped: maximum number of running instances reached (1) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:14:48 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (2.185 1690 2.185) gunicorn-registry stdout | 2021-11-08 14:14:48,862 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:14:48 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:14:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:00 UTC)" (scheduled at 2021-11-08 14:14:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:14:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:50 UTC)" (scheduled at 2021-11-08 14:14:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:14:50,814 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:14:50,837 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:14:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:21 UTC)" (scheduled at 2021-11-08 14:14:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:14:52,211 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:14:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:22 UTC)" (scheduled at 2021-11-08 14:14:52.617060+00:00) repositorygcworker stdout | 2021-11-08 14:14:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:54 UTC)" (scheduled at 2021-11-08 14:14:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:14:54,277 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:14:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:55 UTC)" (scheduled at 2021-11-08 14:14:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:14:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:15:55 UTC)" executed successfully gcworker stdout | 2021-11-08 14:14:56,507 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:22 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:15:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:10 UTC)" (scheduled at 2021-11-08 14:15:00.322052+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:15:00,506 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:15:02,763 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:15:03 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (2.539 325 2.539) gunicorn-registry stdout | 2021-11-08 14:15:03,073 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:15:03 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 14:15:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:06 UTC)" (scheduled at 2021-11-08 14:15:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:15:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:06 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:15:06,663 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:06 +0000] "GET /api/v1/repository/13038/sample-redis/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:06 +0000] "GET /api/v1/repository/13038/sample-redis/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/13038/sample-redis?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (2.107 427 2.107) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:06 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (3.830 1690 3.830) gunicorn-registry stdout | 2021-11-08 14:15:06,925 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:06 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:15:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:09 UTC)" (scheduled at 2021-11-08 14:15:09.376681+00:00) notificationworker stdout | 2021-11-08 14:15:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:15:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:20 UTC)" (scheduled at 2021-11-08 14:15:10.322052+00:00) notificationworker stdout | 2021-11-08 14:15:10,974 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:13 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.452 448 0.452) gunicorn-web stdout | 2021-11-08 14:15:13,330 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:13 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:13 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.913 91 0.913) gunicorn-web stdout | 2021-11-08 14:15:13,791 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:13 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:15:13,821 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:13 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:13 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.944 316 0.944) gunicorn-web stdout | 2021-11-08 14:15:13,828 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:13 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:13 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.950 191 0.950) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:14 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.810 92 1.810) gunicorn-web stdout | 2021-11-08 14:15:14,688 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:14 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 14:15:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:16 UTC)" (scheduled at 2021-11-08 14:15:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:15:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:15:17,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:17 UTC)" skipped: maximum number of running instances reached (1) notificationworker stdout | 2021-11-08 14:15:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:30 UTC)" (scheduled at 2021-11-08 14:15:20.322052+00:00) notificationworker stdout | 2021-11-08 14:15:21,067 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:15:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:51 UTC)" (scheduled at 2021-11-08 14:15:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:15:21,828 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:15:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:52 UTC)" (scheduled at 2021-11-08 14:15:22.617060+00:00) gcworker stdout | 2021-11-08 14:15:23,351 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:23 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:15:23,364 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:23 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:15:23,380 [242] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:23 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) gunicorn-registry stdout | 2021-11-08 14:15:23,382 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:23 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gunicorn-web stdout | 2021-11-08 14:15:23,818 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:23 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:23 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.406 485 1.406) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:23 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch?includeStats=true&includeTags=false HTTP/2.0" 200 3642 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.453 156 1.453) gunicorn-web stdout | 2021-11-08 14:15:23,865 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:23 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch?includeStats=true&includeTags=false HTTP/1.0" 200 3642 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:25 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.087 412 1.086) gunicorn-web stdout | 2021-11-08 14:15:25,453 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:25 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:15:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:27 UTC)" (scheduled at 2021-11-08 14:15:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:15:28,110 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:15:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:40 UTC)" (scheduled at 2021-11-08 14:15:30.322052+00:00) notificationworker stdout | 2021-11-08 14:15:30,375 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:15:31,228 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:15:31,228 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:15:31,230 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:15:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:15:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:50 UTC)" (scheduled at 2021-11-08 14:15:40.322052+00:00) notificationworker stdout | 2021-11-08 14:15:42,848 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:15:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:15:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:17 UTC)" (scheduled at 2021-11-08 14:15:47.787050+00:00) securityworker stdout | 2021-11-08 14:15:49,381 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:15:49,384 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 14:15:49,387 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 14:15:49,389 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:15:49,392 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 250-290 securityworker stdout | 2021-11-08 14:15:49,394 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 14:15:49,397 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:15:49,398 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 14:15:49,401 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:15:49,403 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 14:15:49,405 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:15:49,407 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:15:49,409 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:15:49,411 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 14:15:49,413 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:15:49,415 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 358-398 securityworker stdout | 2021-11-08 14:15:49,417 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 398-438 securityworker stdout | 2021-11-08 14:15:49,419 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:15:49,421 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:15:49,421 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:15:49,423 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 52-92 securityworker stdout | 2021-11-08 14:15:49,425 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 14:15:49,428 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:15:49,430 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 362-402 securityworker stdout | 2021-11-08 14:15:49,432 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 14:15:49,434 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 14:15:49,437 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 14:15:49,439 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 exportactionlogsworker stdout | 2021-11-08 14:15:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:20:49 UTC)" (scheduled at 2021-11-08 14:15:49.438907+00:00) securityworker stdout | 2021-11-08 14:15:49,441 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 93-133 securityworker stdout | 2021-11-08 14:15:49,444 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 14:15:49,446 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 14:15:49,449 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:15:49,452 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 14:15:49,454 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:15:49,456 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 exportactionlogsworker stdout | 2021-11-08 14:15:49,457 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:20:49 UTC)" executed successfully securityworker stdout | 2021-11-08 14:15:49,458 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:15:49,461 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 14:15:49,463 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 133-173 securityworker stdout | 2021-11-08 14:15:49,466 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 14:15:49,466 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:15:49,476 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:15:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:00 UTC)" (scheduled at 2021-11-08 14:15:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:15:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:50 UTC)" (scheduled at 2021-11-08 14:15:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:15:50,409 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:15:50,449 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:15:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:21 UTC)" (scheduled at 2021-11-08 14:15:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:15:52,081 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:15:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:22 UTC)" (scheduled at 2021-11-08 14:15:52.617060+00:00) gcworker stdout | 2021-11-08 14:15:52,918 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:15:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:54 UTC)" (scheduled at 2021-11-08 14:15:54.169080+00:00) namespacegcworker stdout | 2021-11-08 14:15:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:55 UTC)" (scheduled at 2021-11-08 14:15:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:15:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:55 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:15:55,165 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:16:54 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:15:56,322 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:ccc5d391ef8356916acbbb678f030c0c1a711b2af925d8074a9072e0914ed59d/security?vulnerabilities=true HTTP/1.0" 200 27583 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:ccc5d391ef8356916acbbb678f030c0c1a711b2af925d8074a9072e0914ed59d/security?vulnerabilities=true HTTP/2.0" 200 27583 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.181 133 30.181) gunicorn-web stdout | 2021-11-08 14:15:56,437 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:493e6260308491ea7bc4b59e9b784145264b4dccb25293f0c5e5000040e3cbce/security?vulnerabilities=true HTTP/1.0" 200 27583 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:493e6260308491ea7bc4b59e9b784145264b4dccb25293f0c5e5000040e3cbce/security?vulnerabilities=true HTTP/2.0" 200 27583 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.299 133 30.299) gunicorn-web stdout | 2021-11-08 14:15:56,477 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:5ad4edc9e8d289df12956d2e99f50a70404404942b7b014a599f0e785d4552b5/security?vulnerabilities=true HTTP/1.0" 200 27579 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:5ad4edc9e8d289df12956d2e99f50a70404404942b7b014a599f0e785d4552b5/security?vulnerabilities=true HTTP/2.0" 200 27579 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.341 539 30.341) gunicorn-web stdout | 2021-11-08 14:15:56,714 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:15:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:8f15766b20492abc29824da671f2583b26005f51cc4d0085a63e4f8be99a54c4/security?vulnerabilities=true HTTP/1.0" 200 27579 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:15:56 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:8f15766b20492abc29824da671f2583b26005f51cc4d0085a63e4f8be99a54c4/security?vulnerabilities=true HTTP/2.0" 200 27579 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.578 134 30.578) notificationworker stdout | 2021-11-08 14:16:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:10 UTC)" (scheduled at 2021-11-08 14:16:00.322052+00:00) notificationworker stdout | 2021-11-08 14:16:01,597 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:02 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.007 228 0.007) gunicorn-registry stdout | 2021-11-08 14:16:02,509 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:02 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-web stdout | 2021-11-08 14:16:03,496 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:03 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:03 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (5.663 411 5.663) nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:16:04 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (1.539 325 1.539) gunicorn-registry stdout | 2021-11-08 14:16:04,069 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:16:04 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:04 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.066 1689 0.066) gunicorn-registry stdout | 2021-11-08 14:16:04,164 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:04 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:05 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.007 228 0.007) gunicorn-registry stdout | 2021-11-08 14:16:05,503 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:05 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:16:05,653 [239] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:16:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:16:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.127 325 0.127) securityworker stdout | 2021-11-08 14:16:05,869 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:16:05,870 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:16:05,871 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:17 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:16:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:06 UTC)" (scheduled at 2021-11-08 14:16:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:16:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:07 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (1.853 1690 1.853) gunicorn-registry stdout | 2021-11-08 14:16:07,525 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:07 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:16:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:09 UTC)" (scheduled at 2021-11-08 14:16:09.376681+00:00) notificationworker stdout | 2021-11-08 14:16:09,378 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:16:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:20 UTC)" (scheduled at 2021-11-08 14:16:10.322052+00:00) notificationworker stdout | 2021-11-08 14:16:10,868 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:20 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:16:16,028 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.053 437 1.053) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:16:16,405 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-web stdout | 2021-11-08 14:16:16,453 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.478 89 1.478) gunicorn-web stdout | 2021-11-08 14:16:16,493 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.516 91 1.516) gunicorn-web stdout | 2021-11-08 14:16:16,494 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.518 112 1.518) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.644 92 1.645) gunicorn-web stdout | 2021-11-08 14:16:16,650 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:16 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-registry stdout | 2021-11-08 14:16:16,826 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:16:16 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:16:16 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.398 325 0.398) repositorygcworker stdout | 2021-11-08 14:16:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:16 UTC)" (scheduled at 2021-11-08 14:16:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:16:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:16 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:16:17,092 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:17 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:17 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.244 1690 0.244) securityworker stdout | 2021-11-08 14:16:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:47 UTC)" (scheduled at 2021-11-08 14:16:17.787050+00:00) securityworker stdout | 2021-11-08 14:16:17,809 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 14:16:17,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 14:16:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 14:16:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:16:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 14:16:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:16:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 14:16:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 14:16:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:16:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 14:16:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 14:16:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 14:16:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 14:16:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 33-73 securityworker stdout | 2021-11-08 14:16:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:16:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 14:16:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:16:17,881 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:16:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 14:16:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 14:16:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 33-73 securityworker stdout | 2021-11-08 14:16:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:16:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 14:16:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 14:16:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 14:16:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 14:16:17,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 14:16:17,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:16:17,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 14:16:17,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 14:16:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:16:17,943 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 14:16:17,946 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 14:16:17,949 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:16:17,952 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:16:17,954 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:16:17,956 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 14:16:18,013 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 14:16:18,013 [102] [INFO] [util.migrate.allocator] No more work nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:18 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:16:18,498 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:18 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:16:18 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.084 325 0.084) gunicorn-registry stdout | 2021-11-08 14:16:18,601 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:16:18 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.021 1690 0.021) gunicorn-registry stdout | 2021-11-08 14:16:18,639 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:16:18,713 [102] [INFO] [util.migrate.allocator] Found 37 candidates, processing block notificationworker stdout | 2021-11-08 14:16:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:30 UTC)" (scheduled at 2021-11-08 14:16:20.322052+00:00) notificationworker stdout | 2021-11-08 14:16:20,638 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:16:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:51 UTC)" (scheduled at 2021-11-08 14:16:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:16:22,198 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:51 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:22 +0000] "GET /api/v1/repository/finacle10225/fdm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.498 465 0.498) gunicorn-web stdout | 2021-11-08 14:16:22,203 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:22 +0000] "GET /api/v1/repository/finacle10225/fdm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:22 +0000] "GET /api/v1/repository/finacle10225/fdm?includeStats=true&includeTags=false HTTP/2.0" 200 3627 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.538 310 0.538) gunicorn-web stdout | 2021-11-08 14:16:22,248 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:22 +0000] "GET /api/v1/repository/finacle10225/fdm?includeStats=true&includeTags=false HTTP/1.0" 200 3627 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gcworker stdout | 2021-11-08 14:16:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:52 UTC)" (scheduled at 2021-11-08 14:16:22.617060+00:00) gcworker stdout | 2021-11-08 14:16:22,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:23 +0000] "GET /api/v1/repository/finacle10225/fdm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.606 504 0.606) gunicorn-web stdout | 2021-11-08 14:16:23,467 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:23 +0000] "GET /api/v1/repository/finacle10225/fdm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:16:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:27 UTC)" (scheduled at 2021-11-08 14:16:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:16:27,929 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:16:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:40 UTC)" (scheduled at 2021-11-08 14:16:30.322052+00:00) notificationworker stdout | 2021-11-08 14:16:30,671 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:34 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:16:34,926 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:34 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:16:35 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.926 325 0.926) gunicorn-registry stdout | 2021-11-08 14:16:35,875 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:16:35 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:36 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.823 1691 0.823) gunicorn-registry stdout | 2021-11-08 14:16:36,718 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:36 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:16:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:50 UTC)" (scheduled at 2021-11-08 14:16:40.322052+00:00) notificationworker stdout | 2021-11-08 14:16:43,178 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:16:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:16:43,873 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:16:43,873 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:16:43,874 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:16:47 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:47 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:16:47,277 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:47 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:16:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:17 UTC)" (scheduled at 2021-11-08 14:16:47.787050+00:00) securityworker stdout | 2021-11-08 14:16:49,461 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 14:16:49,465 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 14:16:49,468 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:16:49,471 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:16:49,474 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 14:16:49,571 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:16:49,703 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 14:16:49,705 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 14:16:49,708 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 158-198 securityworker stdout | 2021-11-08 14:16:49,711 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 289-329 securityworker stdout | 2021-11-08 14:16:49,713 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 14:16:49,716 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:16:49,719 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 14:16:49,721 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 14:16:49,721 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:16:49,724 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:16:49 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (2.414 325 2.414) gunicorn-registry stdout | 2021-11-08 14:16:49,724 [232] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:16:49 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:16:49,726 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 18-58 securityworker stdout | 2021-11-08 14:16:49,728 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 14:16:49,731 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 14:16:49,734 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 14:16:49,738 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:16:49,741 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:16:49,744 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 199-239 securityworker stdout | 2021-11-08 14:16:49,746 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:16:49,750 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 14:16:49,753 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:16:49,756 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 14:16:49,759 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:16:49,763 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 14:16:49,766 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 14:16:49,769 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 14:16:49,772 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 277-317 securityworker stdout | 2021-11-08 14:16:49,775 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 239-279 securityworker stdout | 2021-11-08 14:16:49,778 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 14:16:49,778 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:16:49,790 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:49 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.165 1690 0.165) gunicorn-registry stdout | 2021-11-08 14:16:49,912 [232] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:49 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:16:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:00 UTC)" (scheduled at 2021-11-08 14:16:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:16:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:50 UTC)" (scheduled at 2021-11-08 14:16:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:16:50,585 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:16:50,594 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:16:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:21 UTC)" (scheduled at 2021-11-08 14:16:51.793811+00:00) gcworker stdout | 2021-11-08 14:16:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:22 UTC)" (scheduled at 2021-11-08 14:16:52.617060+00:00) buildlogsarchiver stdout | 2021-11-08 14:16:53,087 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:16:53,252 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:16:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:54 UTC)" (scheduled at 2021-11-08 14:16:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:16:54,186 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:54 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:16:54,436 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:54 +0000] "GET /api/v1/repository/finacle10225/fdm/manifest/sha256:9fb6ad7c3c9d24aeba4ca4cff1d45337c3e0383b2c0fcdb4270c1a2610f885e4/security?vulnerabilities=true HTTP/1.0" 200 28053 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:54 +0000] "GET /api/v1/repository/finacle10225/fdm/manifest/sha256:9fb6ad7c3c9d24aeba4ca4cff1d45337c3e0383b2c0fcdb4270c1a2610f885e4/security?vulnerabilities=true HTTP/2.0" 200 28053 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.120 595 30.120) gunicorn-web stdout | 2021-11-08 14:16:54,595 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:54 +0000] "GET /api/v1/repository/finacle10225/fdm/manifest/sha256:158e82f2b45a4853d2883961f452442083f96f22b112da27723de4d38043112f/security?vulnerabilities=true HTTP/1.0" 200 28057 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:54 +0000] "GET /api/v1/repository/finacle10225/fdm/manifest/sha256:158e82f2b45a4853d2883961f452442083f96f22b112da27723de4d38043112f/security?vulnerabilities=true HTTP/2.0" 200 28057 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.276 124 30.276) gunicorn-web stdout | 2021-11-08 14:16:54,809 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:54 +0000] "GET /api/v1/repository/finacle10225/fdm/manifest/sha256:062673537663a509ae73bafbfaa17a97e18e22848b2e924fe55c1df03cf71877/security?vulnerabilities=true HTTP/1.0" 200 28057 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:54 +0000] "GET /api/v1/repository/finacle10225/fdm/manifest/sha256:062673537663a509ae73bafbfaa17a97e18e22848b2e924fe55c1df03cf71877/security?vulnerabilities=true HTTP/2.0" 200 28057 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.490 124 30.490) gunicorn-web stdout | 2021-11-08 14:16:54,870 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:16:54 +0000] "GET /api/v1/repository/finacle10225/fdm/manifest/sha256:a1d117c908ff64f37ad5190791dd80a2047e35ae14c9e00e60ffdd4b82e96d99/security?vulnerabilities=true HTTP/1.0" 200 28053 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:16:54 +0000] "GET /api/v1/repository/finacle10225/fdm/manifest/sha256:a1d117c908ff64f37ad5190791dd80a2047e35ae14c9e00e60ffdd4b82e96d99/security?vulnerabilities=true HTTP/2.0" 200 28053 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (30.553 124 30.553) namespacegcworker stdout | 2021-11-08 14:16:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:55 UTC)" (scheduled at 2021-11-08 14:16:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:16:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:17:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:17:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:10 UTC)" (scheduled at 2021-11-08 14:17:00.322052+00:00) notificationworker stdout | 2021-11-08 14:17:02,026 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:02 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:17:02,615 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:02 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:17:03 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.399 325 0.399) gunicorn-registry stdout | 2021-11-08 14:17:03,035 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:17:03 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:17:06,356 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:17:06,357 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:17:06,357 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:17 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:17:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:06 UTC)" (scheduled at 2021-11-08 14:17:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:17:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:06 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (3.653 1690 3.653) gunicorn-registry stdout | 2021-11-08 14:17:06,708 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:06 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:17:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:09 UTC)" (scheduled at 2021-11-08 14:17:09.376681+00:00) notificationworker stdout | 2021-11-08 14:17:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:17:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:20 UTC)" (scheduled at 2021-11-08 14:17:10.322052+00:00) notificationworker stdout | 2021-11-08 14:17:11,497 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:17:16,413 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:17:16,424 [245] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} gunicorn-registry stdout | 2021-11-08 14:17:16,426 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:16 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:16 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:17:16,497 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:17:16,882 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:17:16 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:17:16 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.367 325 0.367) repositorygcworker stdout | 2021-11-08 14:17:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:16 UTC)" (scheduled at 2021-11-08 14:17:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:17:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:17:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:47 UTC)" (scheduled at 2021-11-08 14:17:17.787050+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (1.124 1690 1.124) gunicorn-registry stdout | 2021-11-08 14:17:18,026 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:17:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:30 UTC)" (scheduled at 2021-11-08 14:17:20.322052+00:00) securityworker stdout | 2021-11-08 14:17:20,463 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 77-117 notificationworker stdout | 2021-11-08 14:17:20,463 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:17:20,466 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 27-67 securityworker stdout | 2021-11-08 14:17:20,469 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 14:17:20,472 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 14:17:20,474 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 14:17:20,477 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:17:20,482 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 14:17:20,485 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 454-464 securityworker stdout | 2021-11-08 14:17:20,488 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 14:17:20,491 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 14:17:20,493 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 14:17:20,495 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 14:17:20,497 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 14:17:20,500 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 14:17:20,502 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 14:17:20,504 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 391-431 securityworker stdout | 2021-11-08 14:17:20,504 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:17:20,507 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:17:20,509 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 14:17:20,511 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:17:20,513 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 14:17:20,515 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 14:17:20,517 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 14:17:20,520 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 14:17:20,522 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 14:17:20,525 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 14:17:20,526 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 14:17:20,529 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:17:20,531 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 14:17:20,534 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 14:17:20,537 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:17:20,539 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:17:20,542 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 14:17:20,545 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 14:17:20,548 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 14:17:20,548 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:17:20,558 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block buildlogsarchiver stdout | 2021-11-08 14:17:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:51 UTC)" (scheduled at 2021-11-08 14:17:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:17:21,855 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:17:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:52 UTC)" (scheduled at 2021-11-08 14:17:22.617060+00:00) gcworker stdout | 2021-11-08 14:17:23,239 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:24 +0000] "GET /api/v1/repository/finacle10225/fdm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.921 402 0.921) gunicorn-web stdout | 2021-11-08 14:17:24,754 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:24 +0000] "GET /api/v1/repository/finacle10225/fdm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:24 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.037 70 0.037) gunicorn-web stdout | 2021-11-08 14:17:24,887 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:24 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:25 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.227 383 0.227) gunicorn-web stdout | 2021-11-08 14:17:25,077 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:25 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:26 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.006 228 0.006) gunicorn-registry stdout | 2021-11-08 14:17:26,388 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:26 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:17:26,506 [239] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:17:26 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:17:26 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.086 325 0.086) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:26 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.207 1692 0.207) gunicorn-registry stdout | 2021-11-08 14:17:26,736 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:26 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:17:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:27 UTC)" (scheduled at 2021-11-08 14:17:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:17:27,901 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:17:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:40 UTC)" (scheduled at 2021-11-08 14:17:30.322052+00:00) notificationworker stdout | 2021-11-08 14:17:30,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:17:39,620 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:17:39,620 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:17:39,621 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:17:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:17:40,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:50 UTC)" (scheduled at 2021-11-08 14:17:40.322052+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:17:42,497 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:17:42,577 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:17:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:17:42,601 [239] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:17:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:17:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.085 325 0.085) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:17:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) gunicorn-registry stdout | 2021-11-08 14:17:42,640 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:17:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" manifestbackfillworker stdout | 2021-11-08 14:17:44,033 [76] [INFO] [apscheduler.executors.default] Running job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2021-11-08 14:17:44 UTC)" (scheduled at 2021-11-08 14:17:44.032264+00:00) manifestbackfillworker stdout | 2021-11-08 14:17:44,282 [76] [INFO] [apscheduler.executors.default] Job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2021-11-08 15:17:44 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:17:46,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:22:46 UTC)" (scheduled at 2021-11-08 14:17:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:17:47,058 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:22:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:17:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:17 UTC)" (scheduled at 2021-11-08 14:17:47.787050+00:00) securityworker stdout | 2021-11-08 14:17:48,169 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 32-72 securityworker stdout | 2021-11-08 14:17:48,172 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:17:48,174 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:17:48,177 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 381-421 securityworker stdout | 2021-11-08 14:17:48,179 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 14:17:48,181 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:17:48,185 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:17:48,188 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 14:17:48,191 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 133-173 securityworker stdout | 2021-11-08 14:17:48,193 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 14:17:48,196 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 14:17:48,201 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 14:17:48,204 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 14:17:48,208 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 14:17:48,211 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:17:48,214 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:17:48,217 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 268-308 securityworker stdout | 2021-11-08 14:17:48,219 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 173-213 securityworker stdout | 2021-11-08 14:17:48,221 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:17:48,222 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:17:48,224 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 14:17:48,227 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 14:17:48,230 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 14:17:48,232 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 121-161 securityworker stdout | 2021-11-08 14:17:48,235 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 161-201 securityworker stdout | 2021-11-08 14:17:48,237 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:17:48,240 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 14:17:48,243 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:17:48,246 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 14:17:48,248 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 14:17:48,251 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 14:17:48,253 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:17:48,256 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 14:17:48,259 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 392-432 securityworker stdout | 2021-11-08 14:17:48,261 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 432-464 securityworker stdout | 2021-11-08 14:17:48,263 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:17:48,266 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 14:17:48,269 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 14:17:48,269 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:17:48,654 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:17:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:00 UTC)" (scheduled at 2021-11-08 14:17:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:17:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:50 UTC)" (scheduled at 2021-11-08 14:17:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:17:50,409 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:17:50,447 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:17:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:21 UTC)" (scheduled at 2021-11-08 14:17:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:17:51,835 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:17:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:22:52 UTC)" (scheduled at 2021-11-08 14:17:52.376404+00:00) gcworker stdout | 2021-11-08 14:17:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:22 UTC)" (scheduled at 2021-11-08 14:17:52.617060+00:00) gcworker stdout | 2021-11-08 14:17:52,936 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:22 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:17:53,080 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:22:52 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:17:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:54 UTC)" (scheduled at 2021-11-08 14:17:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:17:54,240 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:17:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:55 UTC)" (scheduled at 2021-11-08 14:17:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:17:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:18:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:18:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:10 UTC)" (scheduled at 2021-11-08 14:18:00.322052+00:00) notificationworker stdout | 2021-11-08 14:18:00,484 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:01 +0000] "GET /api/v1/repository/finacle10225/fdm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.304 401 1.304) gunicorn-web stdout | 2021-11-08 14:18:01,026 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:01 +0000] "GET /api/v1/repository/finacle10225/fdm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fdm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.047 448 0.047) gunicorn-web stdout | 2021-11-08 14:18:02,411 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.056 89 0.056) gunicorn-web stdout | 2021-11-08 14:18:02,420 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:18:02,431 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.068 78 0.068) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.109 92 0.109) gunicorn-web stdout | 2021-11-08 14:18:02,473 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.126 91 0.126) gunicorn-web stdout | 2021-11-08 14:18:02,491 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:04 +0000] "GET /api/v1/repository/finacle10225/finaclecrm?includeStats=true&includeTags=false HTTP/2.0" 200 3635 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.049 472 0.049) gunicorn-web stdout | 2021-11-08 14:18:04,482 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:04 +0000] "GET /api/v1/repository/finacle10225/finaclecrm?includeStats=true&includeTags=false HTTP/1.0" 200 3635 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:04 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.057 421 0.057) gunicorn-web stdout | 2021-11-08 14:18:04,506 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:04 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:05 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.331 468 0.331) gunicorn-web stdout | 2021-11-08 14:18:05,402 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:05 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" exportactionlogsworker stdout | 2021-11-08 14:18:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:06 UTC)" (scheduled at 2021-11-08 14:18:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:18:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:18:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:09 UTC)" (scheduled at 2021-11-08 14:18:09.376681+00:00) notificationworker stdout | 2021-11-08 14:18:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:18:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:20 UTC)" (scheduled at 2021-11-08 14:18:10.322052+00:00) notificationworker stdout | 2021-11-08 14:18:11,149 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:18:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:23:14 UTC)" (scheduled at 2021-11-08 14:18:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:18:15,356 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:23:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:18:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:16 UTC)" (scheduled at 2021-11-08 14:18:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:18:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:18:17,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:17 UTC)" skipped: maximum number of running instances reached (1) notificationworker stdout | 2021-11-08 14:18:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:30 UTC)" (scheduled at 2021-11-08 14:18:20.322052+00:00) notificationworker stdout | 2021-11-08 14:18:20,551 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:18:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:51 UTC)" (scheduled at 2021-11-08 14:18:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:18:21,893 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:51 UTC)" executed successfully securityworker stdout | 2021-11-08 14:18:22,008 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:18:22,008 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:18:22,009 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:47 UTC)" executed successfully gcworker stdout | 2021-11-08 14:18:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:52 UTC)" (scheduled at 2021-11-08 14:18:22.617060+00:00) gunicorn-web stdout | 2021-11-08 14:18:23,474 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:23 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:cbccbf418c361d7484e9277dcb0839e75c5603159574d3e1f07020de2bb9a6b7/security?vulnerabilities=true HTTP/1.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:23 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:cbccbf418c361d7484e9277dcb0839e75c5603159574d3e1f07020de2bb9a6b7/security?vulnerabilities=true HTTP/2.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (17.605 129 17.479) gunicorn-web stdout | 2021-11-08 14:18:26,799 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:26 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:bcb4a3e6e27c441ccb318e96569343890341fb7289f38b9b93537b798489e006/security?vulnerabilities=true HTTP/1.0" 200 944287 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:26 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:bcb4a3e6e27c441ccb318e96569343890341fb7289f38b9b93537b798489e006/security?vulnerabilities=true HTTP/2.0" 200 944287 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (20.925 545 20.806) gunicorn-web stdout | 2021-11-08 14:18:26,997 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:26 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:aac68378af914022798fffa1d9fa66866647f0160cc8cf8ee62d13b10e510358/security?vulnerabilities=true HTTP/1.0" 200 944287 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:27 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:aac68378af914022798fffa1d9fa66866647f0160cc8cf8ee62d13b10e510358/security?vulnerabilities=true HTTP/2.0" 200 944287 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (21.086 128 21.001) gcworker stdout | 2021-11-08 14:18:27,816 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:18:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:18:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:27 UTC)" (scheduled at 2021-11-08 14:18:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:18:27,897 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:27 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:18:29,967 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:29 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:8eb18624aa86ddabecefe4e882c45bad241dcac6d32b5379defb649ec9f239d2/security?vulnerabilities=true HTTP/1.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:30 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:8eb18624aa86ddabecefe4e882c45bad241dcac6d32b5379defb649ec9f239d2/security?vulnerabilities=true HTTP/2.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (24.077 129 23.972) notificationworker stdout | 2021-11-08 14:18:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:40 UTC)" (scheduled at 2021-11-08 14:18:30.322052+00:00) notificationworker stdout | 2021-11-08 14:18:31,035 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:40 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:18:38,837 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:38 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:38 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.499 407 0.498) notificationworker stdout | 2021-11-08 14:18:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:50 UTC)" (scheduled at 2021-11-08 14:18:40.322052+00:00) notificationworker stdout | 2021-11-08 14:18:40,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:18:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:18:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:17 UTC)" (scheduled at 2021-11-08 14:18:47.787050+00:00) securityworker stdout | 2021-11-08 14:18:48,028 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 14:18:48,031 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 14:18:48,033 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:18:48,035 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 14:18:48,038 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 14:18:48,041 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:18:48,043 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:18:48,045 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 14:18:48,047 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 14:18:48,049 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:18:48,051 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 14:18:48,053 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:18:48,055 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 14:18:48,058 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:18:48,060 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 14:18:48,062 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 14:18:48,062 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:18:48,064 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:18:48,067 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 14-54 securityworker stdout | 2021-11-08 14:18:48,069 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:18:48,072 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 14:18:48,074 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 14:18:48,077 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 14:18:48,081 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:18:48,084 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 14:18:48,087 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:18:48,090 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 14:18:48,094 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 14:18:48,097 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 204-244 securityworker stdout | 2021-11-08 14:18:48,099 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 14:18:48,102 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 14:18:48,105 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:18:48,105 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:18:48,113 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block servicekey stdout | 2021-11-08 14:18:50,142 [103] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2021-11-08 14:18:50 UTC)" (scheduled at 2021-11-08 14:18:50.141249+00:00) notificationworker stdout | 2021-11-08 14:18:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:00 UTC)" (scheduled at 2021-11-08 14:18:50.322052+00:00) notificationworker stdout | 2021-11-08 14:18:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:18:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:50 UTC)" (scheduled at 2021-11-08 14:18:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:18:50,408 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:18:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:21 UTC)" (scheduled at 2021-11-08 14:18:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:18:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:18:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:22 UTC)" (scheduled at 2021-11-08 14:18:52.617060+00:00) gcworker stdout | 2021-11-08 14:18:52,658 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:22 UTC)" executed successfully servicekey stdout | 2021-11-08 14:18:52,813 [103] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2021-11-08 15:13:50 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:18:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:54 UTC)" (scheduled at 2021-11-08 14:18:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:18:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:18:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:55 UTC)" (scheduled at 2021-11-08 14:18:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:18:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:19:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:58 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:18:58,991 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:58 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:59 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.007 228 0.007) gunicorn-registry stdout | 2021-11-08 14:18:59,697 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:59 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:18:59,813 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:18:59 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:18:59 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.709 325 0.709) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:18:59 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1689 0.016) gunicorn-registry stdout | 2021-11-08 14:18:59,957 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:18:59 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:19:00,138 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:19:00 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:19:00 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.306 325 0.306) gunicorn-registry stdout | 2021-11-08 14:19:00,279 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:19:00 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:19:00 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1690 0.016) notificationworker stdout | 2021-11-08 14:19:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:10 UTC)" (scheduled at 2021-11-08 14:19:00.322052+00:00) notificationworker stdout | 2021-11-08 14:19:00,351 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:19:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:06 UTC)" (scheduled at 2021-11-08 14:19:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:19:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:19:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:09 UTC)" (scheduled at 2021-11-08 14:19:09.376681+00:00) notificationworker stdout | 2021-11-08 14:19:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:19:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:20 UTC)" (scheduled at 2021-11-08 14:19:10.322052+00:00) notificationworker stdout | 2021-11-08 14:19:11,371 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:19:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:16 UTC)" (scheduled at 2021-11-08 14:19:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:19:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:19:17,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:17 UTC)" skipped: maximum number of running instances reached (1) notificationworker stdout | 2021-11-08 14:19:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:30 UTC)" (scheduled at 2021-11-08 14:19:20.322052+00:00) securityworker stdout | 2021-11-08 14:19:21,089 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:19:21,089 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:19:21,090 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:19:21,329 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:19:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:51 UTC)" (scheduled at 2021-11-08 14:19:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:19:21,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:19:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:52 UTC)" (scheduled at 2021-11-08 14:19:22.617060+00:00) gcworker stdout | 2021-11-08 14:19:22,663 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:19:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:19:23 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.829 429 0.828) gunicorn-web stdout | 2021-11-08 14:19:23,184 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:19:23 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:19:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:27 UTC)" (scheduled at 2021-11-08 14:19:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:19:28,812 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:19:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:40 UTC)" (scheduled at 2021-11-08 14:19:30.322052+00:00) notificationworker stdout | 2021-11-08 14:19:30,486 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:19:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:50 UTC)" (scheduled at 2021-11-08 14:19:40.322052+00:00) notificationworker stdout | 2021-11-08 14:19:41,082 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:19:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:19:41 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.003) gunicorn-registry stdout | 2021-11-08 14:19:41,282 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:19:41 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:19:41,931 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:19:41 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:19:41 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.625 325 0.625) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:19:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.287 1690 0.287) gunicorn-registry stdout | 2021-11-08 14:19:42,240 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:19:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:19:46 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.875 407 1.874) gunicorn-web stdout | 2021-11-08 14:19:46,766 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:19:46 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:19:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:17 UTC)" (scheduled at 2021-11-08 14:19:47.787050+00:00) securityworker stdout | 2021-11-08 14:19:48,470 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 14:19:48,473 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 14:19:48,475 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 14:19:48,477 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:19:48,480 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:19:48,482 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 14:19:48,484 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 14:19:48,488 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 14:19:48,491 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 14:19:48,494 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:19:48,496 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 14:19:48,498 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 14:19:48,500 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:19:48,502 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 237-277 securityworker stdout | 2021-11-08 14:19:48,505 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 14:19:48,507 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 14:19:48,507 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:19:48,510 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 14:19:48,512 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:19:48,514 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 14:19:48,517 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 23-63 securityworker stdout | 2021-11-08 14:19:48,520 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 14:19:48,523 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 372-412 securityworker stdout | 2021-11-08 14:19:48,526 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 14:19:48,529 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 14:19:48,532 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:19:48,534 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:19:48,537 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 14:19:48,539 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 14:19:48,541 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 14:19:48,543 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 14:19:48,546 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 447-464 securityworker stdout | 2021-11-08 14:19:48,546 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:19:48,602 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:19:49 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:19:49,497 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:19:49 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:19:49 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.086 325 0.086) gunicorn-registry stdout | 2021-11-08 14:19:49,601 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:19:49 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:19:49 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.068 1690 0.068) gunicorn-registry stdout | 2021-11-08 14:19:49,694 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:19:49 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:19:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:00 UTC)" (scheduled at 2021-11-08 14:19:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:19:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:50 UTC)" (scheduled at 2021-11-08 14:19:50.393684+00:00) notificationworker stdout | 2021-11-08 14:19:50,832 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:19:50,948 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:19:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:21 UTC)" (scheduled at 2021-11-08 14:19:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:19:51,871 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:19:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:22 UTC)" (scheduled at 2021-11-08 14:19:52.617060+00:00) gcworker stdout | 2021-11-08 14:19:52,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:19:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:54 UTC)" (scheduled at 2021-11-08 14:19:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:19:54,348 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:19:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:55 UTC)" (scheduled at 2021-11-08 14:19:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:19:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:20:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:20:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:10 UTC)" (scheduled at 2021-11-08 14:20:00.322052+00:00) notificationworker stdout | 2021-11-08 14:20:00,582 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:20:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:06 UTC)" (scheduled at 2021-11-08 14:20:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:20:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:20:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:09 UTC)" (scheduled at 2021-11-08 14:20:09.376681+00:00) notificationworker stdout | 2021-11-08 14:20:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:20:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:20 UTC)" (scheduled at 2021-11-08 14:20:10.322052+00:00) notificationworker stdout | 2021-11-08 14:20:11,170 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:20 UTC)" executed successfully securityworker stdout | 2021-11-08 14:20:15,906 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:20:15,906 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:20:15,907 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:20:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:16 UTC)" (scheduled at 2021-11-08 14:20:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:20:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:20:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:47 UTC)" (scheduled at 2021-11-08 14:20:17.787050+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:20:18 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:20:18,498 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:20:18 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:20:18,524 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 14:20:18,527 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 14:20:18,531 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:20:18,533 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 14:20:18,535 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:20:18,537 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:20:18,539 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 14:20:18,541 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:20:18,543 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 14:20:18,545 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 14:20:18,548 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:20:18,550 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 14:20:18,552 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 442-464 securityworker stdout | 2021-11-08 14:20:18,554 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 14:20:18,556 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:20:18,557 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 93-133 securityworker stdout | 2021-11-08 14:20:18,559 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:20:18,559 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:20:18,734 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 257-297 securityworker stdout | 2021-11-08 14:20:18,736 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:20:18,738 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 14:20:18,740 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 14:20:18,742 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:20:18,744 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 14:20:18,746 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:20:18,747 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 14:20:18,749 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:20:18,751 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 14:20:18,754 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 14:20:18,756 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 14:20:18,758 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 14:20:18,761 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 179-219 securityworker stdout | 2021-11-08 14:20:18,765 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:20:18,767 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:20:18,769 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:20:18,769 [102] [INFO] [util.migrate.allocator] No more work nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:20:18 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.337 325 0.337) gunicorn-registry stdout | 2021-11-08 14:20:18,855 [237] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:20:18 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:20:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1690 0.019) gunicorn-registry stdout | 2021-11-08 14:20:18,896 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:20:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:20:19,831 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:20:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:30 UTC)" (scheduled at 2021-11-08 14:20:20.322052+00:00) notificationworker stdout | 2021-11-08 14:20:20,527 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:20:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:51 UTC)" (scheduled at 2021-11-08 14:20:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:20:22,395 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:20:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:52 UTC)" (scheduled at 2021-11-08 14:20:22.617060+00:00) gcworker stdout | 2021-11-08 14:20:23,009 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:20:24 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:20:24,337 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:20:24 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:20:24,353 [230] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:20:24 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) gunicorn-registry stdout | 2021-11-08 14:20:24,355 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:20:24 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:20:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:27 UTC)" (scheduled at 2021-11-08 14:20:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:20:28,173 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:20:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:40 UTC)" (scheduled at 2021-11-08 14:20:30.322052+00:00) notificationworker stdout | 2021-11-08 14:20:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:20:40,325 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:50 UTC)" (scheduled at 2021-11-08 14:20:40.322052+00:00) notificationworker stdout | 2021-11-08 14:20:41,778 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:20:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:20:42,157 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:20:42,158 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:20:42,159 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:20:47 UTC)" executed successfully securityworker stdout | 2021-11-08 14:20:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:17 UTC)" (scheduled at 2021-11-08 14:20:47.787050+00:00) securityworker stdout | 2021-11-08 14:20:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:20:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 14:20:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:20:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 14:20:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 219-259 securityworker stdout | 2021-11-08 14:20:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 14:20:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 77-117 securityworker stdout | 2021-11-08 14:20:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 14:20:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 14:20:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 14:20:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 14:20:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:20:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 26-66 securityworker stdout | 2021-11-08 14:20:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:20:47,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:20:47,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 426-464 securityworker stdout | 2021-11-08 14:20:47,909 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:20:47,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:20:47,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:20:47,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 14:20:47,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 68-108 securityworker stdout | 2021-11-08 14:20:47,919 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 133-173 securityworker stdout | 2021-11-08 14:20:47,921 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:20:47,923 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:20:47,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:20:47,926 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 173-213 securityworker stdout | 2021-11-08 14:20:47,928 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 14:20:47,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 14:20:47,932 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 14:20:47,934 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 108-148 securityworker stdout | 2021-11-08 14:20:47,936 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:20:47,938 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 14:20:47,940 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:20:47,942 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:20:47,942 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:20:47,950 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 14:20:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:25:49 UTC)" (scheduled at 2021-11-08 14:20:49.438907+00:00) notificationworker stdout | 2021-11-08 14:20:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:00 UTC)" (scheduled at 2021-11-08 14:20:50.322052+00:00) notificationworker stdout | 2021-11-08 14:20:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:20:50,367 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:25:49 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:20:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:50 UTC)" (scheduled at 2021-11-08 14:20:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:20:50,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:20:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:21 UTC)" (scheduled at 2021-11-08 14:20:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:20:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:20:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:22 UTC)" (scheduled at 2021-11-08 14:20:52.617060+00:00) gcworker stdout | 2021-11-08 14:20:53,172 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:20:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:54 UTC)" (scheduled at 2021-11-08 14:20:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:20:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:20:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:55 UTC)" (scheduled at 2021-11-08 14:20:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:20:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:21:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:21:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:10 UTC)" (scheduled at 2021-11-08 14:21:00.322052+00:00) notificationworker stdout | 2021-11-08 14:21:00,840 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:21:04,581 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:21:05,147 [232] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:21:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:21:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.484 325 0.484) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:05 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.202 1689 0.202) gunicorn-registry stdout | 2021-11-08 14:21:05,369 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:05 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 14:21:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:06 UTC)" (scheduled at 2021-11-08 14:21:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:21:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:21:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:09 UTC)" (scheduled at 2021-11-08 14:21:09.376681+00:00) notificationworker stdout | 2021-11-08 14:21:09,378 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:21:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:20 UTC)" (scheduled at 2021-11-08 14:21:10.322052+00:00) securityworker stdout | 2021-11-08 14:21:10,716 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:21:10,716 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:21:10,717 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:21:11,988 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:21:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:16 UTC)" (scheduled at 2021-11-08 14:21:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:21:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:21:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:47 UTC)" (scheduled at 2021-11-08 14:21:17.787050+00:00) securityworker stdout | 2021-11-08 14:21:19,700 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 14:21:19,703 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:21:19,706 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:21:19,709 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 14:21:19,711 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 14:21:19,714 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 14:21:19,716 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:21:19,718 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 14:21:19,720 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:21:19,723 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 14:21:19,724 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:21:19,726 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:21:19,728 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 14:21:19,731 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 14:21:19,733 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 14:21:19,735 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 14:21:19,737 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 14:21:19,739 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:21:19,739 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:21:19,742 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:21:19,745 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 14:21:19,747 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:21:19,749 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 14:21:19,751 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 14:21:19,753 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 14:21:19,755 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 14:21:19,758 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 14:21:19,760 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 14:21:19,762 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 14:21:19,764 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 14:21:19,767 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:21:19,769 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:21:19,771 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:21:19,773 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 14:21:19,776 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 263-303 securityworker stdout | 2021-11-08 14:21:19,776 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:21:19,785 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:21:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:30 UTC)" (scheduled at 2021-11-08 14:21:20.322052+00:00) notificationworker stdout | 2021-11-08 14:21:20,945 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:21:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:51 UTC)" (scheduled at 2021-11-08 14:21:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:21:22,043 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:51 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:22 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:21:22,497 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:22 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gcworker stdout | 2021-11-08 14:21:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:52 UTC)" (scheduled at 2021-11-08 14:21:22.617060+00:00) nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:21:23 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.916 325 0.916) gunicorn-registry stdout | 2021-11-08 14:21:23,431 [236] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:21:23 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:23 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.022 1690 0.022) gunicorn-registry stdout | 2021-11-08 14:21:23,475 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:23 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gcworker stdout | 2021-11-08 14:21:23,614 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:21:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:27 UTC)" (scheduled at 2021-11-08 14:21:27.884604+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:28 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:21:28,473 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:28 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:21:28,581 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:28 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:28 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 14:21:28,887 [236] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:21:28 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:21:28 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.304 325 0.304) namespacegcworker stdout | 2021-11-08 14:21:28,973 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:27 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:21:29,028 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:21:29 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:21:29 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.330 325 0.329) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:29 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1690 0.014) gunicorn-registry stdout | 2021-11-08 14:21:29,042 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:29 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:21:29,396 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:29 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:29 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.229 1690 0.228) notificationworker stdout | 2021-11-08 14:21:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:40 UTC)" (scheduled at 2021-11-08 14:21:30.322052+00:00) notificationworker stdout | 2021-11-08 14:21:30,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:21:37,988 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:21:37,989 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:21:37,989 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:21:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:21:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:50 UTC)" (scheduled at 2021-11-08 14:21:40.322052+00:00) notificationworker stdout | 2021-11-08 14:21:40,504 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:21:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:46 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:21:46,923 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:46 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:21:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.299 325 0.299) gunicorn-registry stdout | 2021-11-08 14:21:47,240 [240] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:21:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:21:47,277 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:21:47 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:21:47 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1691 0.015) securityworker stdout | 2021-11-08 14:21:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:17 UTC)" (scheduled at 2021-11-08 14:21:47.787050+00:00) securityworker stdout | 2021-11-08 14:21:48,482 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:21:48,485 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 14:21:48,524 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:21:48,527 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:21:48,529 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 14:21:48,532 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 14:21:48,535 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 14:21:48,537 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:21:48,540 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:21:48,542 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:21:48,544 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:21:48,546 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:21:48,549 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 14:21:48,551 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:21:48,553 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 57-97 securityworker stdout | 2021-11-08 14:21:48,556 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:21:48,558 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 392-432 securityworker stdout | 2021-11-08 14:21:48,558 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:21:48,561 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 14:21:48,563 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 14:21:48,565 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 14:21:48,567 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 14:21:48,569 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 257-297 securityworker stdout | 2021-11-08 14:21:48,572 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:21:48,574 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 179-219 securityworker stdout | 2021-11-08 14:21:48,577 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:21:48,580 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 14:21:48,583 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 14:21:48,585 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:21:48,588 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 14:21:48,591 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:21:48,593 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 14:21:48,596 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:21:48,599 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:21:48,601 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 14:21:48,603 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 14:21:48,605 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 14:21:48,605 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:21:48,615 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:21:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:00 UTC)" (scheduled at 2021-11-08 14:21:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:21:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:50 UTC)" (scheduled at 2021-11-08 14:21:50.393684+00:00) notificationworker stdout | 2021-11-08 14:21:50,614 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:21:50,711 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:21:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:21 UTC)" (scheduled at 2021-11-08 14:21:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:21:52,365 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:21:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:22 UTC)" (scheduled at 2021-11-08 14:21:52.617060+00:00) gcworker stdout | 2021-11-08 14:21:52,866 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:21:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:54 UTC)" (scheduled at 2021-11-08 14:21:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:21:54,187 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:21:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:55 UTC)" (scheduled at 2021-11-08 14:21:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:21:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:22:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:22:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:10 UTC)" (scheduled at 2021-11-08 14:22:00.322052+00:00) securityworker stdout | 2021-11-08 14:22:02,038 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:22:02,038 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:22:02,039 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:17 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:02 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:22:02,280 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:02 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:22:02 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.226 325 0.226) gunicorn-registry stdout | 2021-11-08 14:22:02,530 [237] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:22:02 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:03 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.553 1690 0.553) gunicorn-registry stdout | 2021-11-08 14:22:03,135 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:03 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:22:04,966 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:22:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:06 UTC)" (scheduled at 2021-11-08 14:22:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:22:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:08 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:22:08,611 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:08 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:22:08 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.276 325 0.276) gunicorn-registry stdout | 2021-11-08 14:22:08,904 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:22:08 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:08 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.015) gunicorn-registry stdout | 2021-11-08 14:22:08,935 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:08 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:22:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:09 UTC)" (scheduled at 2021-11-08 14:22:09.376681+00:00) notificationworker stdout | 2021-11-08 14:22:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:22:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:20 UTC)" (scheduled at 2021-11-08 14:22:10.322052+00:00) notificationworker stdout | 2021-11-08 14:22:11,282 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:22:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:16 UTC)" (scheduled at 2021-11-08 14:22:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:22:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:22:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:47 UTC)" (scheduled at 2021-11-08 14:22:17.787050+00:00) notificationworker stdout | 2021-11-08 14:22:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:30 UTC)" (scheduled at 2021-11-08 14:22:20.322052+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:20 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:22:20,495 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:20 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:22:20,593 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:22:20 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:22:20 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.080 325 0.080) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:20 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.015) gunicorn-registry stdout | 2021-11-08 14:22:20,627 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:20 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:22:21,025 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:22:21,052 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 14:22:21,055 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:22:21,058 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:22:21,060 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 14:22:21,063 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 173-213 securityworker stdout | 2021-11-08 14:22:21,065 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:22:21,067 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 14:22:21,070 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 215-255 securityworker stdout | 2021-11-08 14:22:21,072 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 14:22:21,075 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 334-374 securityworker stdout | 2021-11-08 14:22:21,077 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:22:21,080 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 14:22:21,081 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 14:22:21,083 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 14:22:21,090 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:22:21,093 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 433-464 securityworker stdout | 2021-11-08 14:22:21,093 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:22:21,095 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:22:21,097 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 14:22:21,099 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 14:22:21,101 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 14:22:21,103 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 14:22:21,105 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 14:22:21,106 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:22:21,109 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:22:21,111 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:22:21,113 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:22:21,115 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 14:22:21,117 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 14:22:21,119 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 14:22:21,121 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 436-464 securityworker stdout | 2021-11-08 14:22:21,123 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 14:22:21,125 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:22:21,125 [102] [INFO] [util.migrate.allocator] No more work nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:21 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:22:21,408 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:21 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:22:21,420 [240] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:21 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) gunicorn-registry stdout | 2021-11-08 14:22:21,422 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:21 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" buildlogsarchiver stdout | 2021-11-08 14:22:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:51 UTC)" (scheduled at 2021-11-08 14:22:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:22:22,530 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:51 UTC)" executed successfully securityworker stdout | 2021-11-08 14:22:22,556 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block gcworker stdout | 2021-11-08 14:22:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:52 UTC)" (scheduled at 2021-11-08 14:22:22.617060+00:00) gcworker stdout | 2021-11-08 14:22:22,982 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:52 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:22:26,644 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:26 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:26 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.377 47 0.377) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:26 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.620 383 0.619) gunicorn-web stdout | 2021-11-08 14:22:26,884 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:26 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:27 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:22:27,382 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:27 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:22:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:27 UTC)" (scheduled at 2021-11-08 14:22:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:22:28,055 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:27 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:22:28,561 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:22:28 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:22:28 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (1.162 325 1.162) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:28 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1692 0.015) gunicorn-registry stdout | 2021-11-08 14:22:28,600 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:28 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:22:30,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:40 UTC)" (scheduled at 2021-11-08 14:22:30.322052+00:00) notificationworker stdout | 2021-11-08 14:22:30,390 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:22:38,759 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:22:38,760 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:22:38,761 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:22:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:22:40,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:50 UTC)" (scheduled at 2021-11-08 14:22:40.322052+00:00) notificationworker stdout | 2021-11-08 14:22:41,225 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:22:50 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:22:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:27:46 UTC)" (scheduled at 2021-11-08 14:22:46.131205+00:00) securityworker stdout | 2021-11-08 14:22:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:17 UTC)" (scheduled at 2021-11-08 14:22:47.787050+00:00) namespacegcworker stdout | 2021-11-08 14:22:48,030 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:27:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:22:48,603 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 14:22:48,608 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 14:22:48,612 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 24-64 securityworker stdout | 2021-11-08 14:22:48,617 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:22:48,619 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:22:48,622 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 217-257 securityworker stdout | 2021-11-08 14:22:48,624 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 14:22:48,626 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 312-352 securityworker stdout | 2021-11-08 14:22:48,629 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:22:48,632 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 289-329 securityworker stdout | 2021-11-08 14:22:48,634 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:22:48,637 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 14:22:48,640 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 14:22:49,315 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 360-400 securityworker stdout | 2021-11-08 14:22:49,319 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 14:22:49,321 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:22:49,321 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:22:49,324 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 14:22:49,326 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:22:49,328 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 14:22:49,330 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 14:22:49,332 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 309-349 securityworker stdout | 2021-11-08 14:22:49,335 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:22:49,337 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 14:22:49,340 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 14:22:49,343 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 288-328 securityworker stdout | 2021-11-08 14:22:49,345 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:22:49,348 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 14:22:49,350 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 14:22:49,353 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:22:49,355 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 14:22:49,357 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 14:22:49,359 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 14:22:49,361 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 453-464 securityworker stdout | 2021-11-08 14:22:49,361 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:22:49,796 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:22:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:00 UTC)" (scheduled at 2021-11-08 14:22:50.322052+00:00) notificationworker stdout | 2021-11-08 14:22:50,360 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:22:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:50 UTC)" (scheduled at 2021-11-08 14:22:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:22:50,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:22:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:21 UTC)" (scheduled at 2021-11-08 14:22:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:22:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:21 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:52 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.524 407 1.523) gunicorn-web stdout | 2021-11-08 14:22:52,021 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:52 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:52 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.037 747 0.037) gunicorn-web stdout | 2021-11-08 14:22:52,351 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:52 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:22:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:27:52 UTC)" (scheduled at 2021-11-08 14:22:52.376404+00:00) notificationworker stdout | 2021-11-08 14:22:52,393 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:27:52 UTC)" executed successfully gcworker stdout | 2021-11-08 14:22:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:22 UTC)" (scheduled at 2021-11-08 14:22:52.617060+00:00) gcworker stdout | 2021-11-08 14:22:52,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:22:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:54 UTC)" (scheduled at 2021-11-08 14:22:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:22:54,556 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:22:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:55 UTC)" (scheduled at 2021-11-08 14:22:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:22:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:23:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:55 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:22:55,496 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:55 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:22:55,602 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:22:55 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:22:55 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.084 325 0.084) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:22:55 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.030 1690 0.030) gunicorn-registry stdout | 2021-11-08 14:22:55,659 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:22:55 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:23:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:10 UTC)" (scheduled at 2021-11-08 14:23:00.322052+00:00) notificationworker stdout | 2021-11-08 14:23:00,686 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:23:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:06 UTC)" (scheduled at 2021-11-08 14:23:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:23:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:23:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:09 UTC)" (scheduled at 2021-11-08 14:23:09.376681+00:00) notificationworker stdout | 2021-11-08 14:23:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:09 UTC)" executed successfully securityworker stdout | 2021-11-08 14:23:09,812 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:23:09,813 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:23:09,814 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:23:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:20 UTC)" (scheduled at 2021-11-08 14:23:10.322052+00:00) notificationworker stdout | 2021-11-08 14:23:11,646 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:23:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:28:14 UTC)" (scheduled at 2021-11-08 14:23:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:23:14,924 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:28:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:23:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:16 UTC)" (scheduled at 2021-11-08 14:23:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:23:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:23:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:47 UTC)" (scheduled at 2021-11-08 14:23:17.787050+00:00) securityworker stdout | 2021-11-08 14:23:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 14:23:17,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 14:23:17,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:23:17,919 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:23:17,921 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 14:23:17,923 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:23:17,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:23:17,927 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 14:23:17,929 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 14:23:17,931 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 14:23:17,933 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 14:23:17,935 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:23:17,937 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 14:23:18,058 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 14:23:18,060 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 14:23:18,062 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 14:23:18,064 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 439-464 securityworker stdout | 2021-11-08 14:23:18,066 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:23:18,066 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:23:18,068 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 108-148 securityworker stdout | 2021-11-08 14:23:18,071 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 14:23:18,073 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 14:23:18,075 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:23:18,077 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 14:23:18,079 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:23:18,080 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:23:18,082 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:23:18,084 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 14:23:18,086 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 14:23:18,088 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 14:23:18,090 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:23:18,092 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 14:23:18,094 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 148-188 securityworker stdout | 2021-11-08 14:23:18,094 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:23:18,186 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:23:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:30 UTC)" (scheduled at 2021-11-08 14:23:20.322052+00:00) notificationworker stdout | 2021-11-08 14:23:20,675 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:23:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:51 UTC)" (scheduled at 2021-11-08 14:23:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:23:21,961 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:23:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:52 UTC)" (scheduled at 2021-11-08 14:23:22.617060+00:00) gcworker stdout | 2021-11-08 14:23:22,807 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:23:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:27 UTC)" (scheduled at 2021-11-08 14:23:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:23:28,050 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:23:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:40 UTC)" (scheduled at 2021-11-08 14:23:30.322052+00:00) notificationworker stdout | 2021-11-08 14:23:30,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:23:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:50 UTC)" (scheduled at 2021-11-08 14:23:40.322052+00:00) notificationworker stdout | 2021-11-08 14:23:41,730 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:23:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:23:42,218 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:23:42,219 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:23:42,220 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:23:47 UTC)" executed successfully securityworker stdout | 2021-11-08 14:23:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:17 UTC)" (scheduled at 2021-11-08 14:23:47.787050+00:00) securityworker stdout | 2021-11-08 14:23:48,605 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:23:48,608 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 14:23:48,611 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 14:23:48,656 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 19-59 securityworker stdout | 2021-11-08 14:23:48,658 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 14:23:48,661 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:23:48,692 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:23:48,695 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 14:23:48,697 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:23:48,700 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 14:23:48,702 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 14:23:48,704 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 451-464 securityworker stdout | 2021-11-08 14:23:48,706 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:23:48,708 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 14:23:48,711 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:23:48,713 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:23:48,716 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:23:48,716 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:23:48,718 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 14:23:48,720 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:23:48,722 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:23:48,724 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:23:48,726 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 14:23:48,728 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:23:48,731 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 14:23:48,733 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:23:48,735 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:23:48,738 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 14:23:48,740 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 14:23:48,743 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 14:23:48,746 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 14:23:48,748 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:23:48,750 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 14:23:48,753 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:23:48,756 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 14:23:48,758 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:23:48,760 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 263-303 securityworker stdout | 2021-11-08 14:23:48,761 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:23:49,139 [102] [INFO] [util.migrate.allocator] Found 37 candidates, processing block notificationworker stdout | 2021-11-08 14:23:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:00 UTC)" (scheduled at 2021-11-08 14:23:50.322052+00:00) notificationworker stdout | 2021-11-08 14:23:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:23:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:50 UTC)" (scheduled at 2021-11-08 14:23:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:23:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:23:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:21 UTC)" (scheduled at 2021-11-08 14:23:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:23:52,459 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:23:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:22 UTC)" (scheduled at 2021-11-08 14:23:52.617060+00:00) gcworker stdout | 2021-11-08 14:23:52,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:23:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:54 UTC)" (scheduled at 2021-11-08 14:23:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:23:54,292 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:23:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:55 UTC)" (scheduled at 2021-11-08 14:23:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:23:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:24:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:24:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:10 UTC)" (scheduled at 2021-11-08 14:24:00.322052+00:00) notificationworker stdout | 2021-11-08 14:24:00,550 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:24:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:06 UTC)" (scheduled at 2021-11-08 14:24:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:24:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:06 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:24:09,093 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:24:09 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:24:09 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.339 325 0.339) notificationworker stdout | 2021-11-08 14:24:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:09 UTC)" (scheduled at 2021-11-08 14:24:09.376681+00:00) notificationworker stdout | 2021-11-08 14:24:09,378 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:24:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:20 UTC)" (scheduled at 2021-11-08 14:24:10.322052+00:00) notificationworker stdout | 2021-11-08 14:24:10,588 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:24:10 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.008 228 0.009) gunicorn-registry stdout | 2021-11-08 14:24:10,975 [234] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:24:10 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:24:11 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.026 1689 0.025) gunicorn-registry stdout | 2021-11-08 14:24:11,499 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:24:11 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 14:24:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:16 UTC)" (scheduled at 2021-11-08 14:24:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:24:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:24:17,065 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:24:17,065 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:24:17,066 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:17 UTC)" executed successfully securityworker stdout | 2021-11-08 14:24:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:47 UTC)" (scheduled at 2021-11-08 14:24:17.787050+00:00) securityworker stdout | 2021-11-08 14:24:18,479 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:24:18,481 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:24:18,504 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 14:24:18,507 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:24:18,510 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 14:24:18,511 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:24:18,514 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 14:24:18,516 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:24:18,518 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 14:24:18,520 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 14:24:18,522 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 14:24:18,524 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 14:24:18,526 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:24:18,528 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 14:24:18,531 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 14:24:18,533 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 14:24:18,535 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 14:24:18,538 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 14:24:18,540 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:24:18,540 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:24:18,542 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 14:24:18,546 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 14:24:18,548 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 14:24:18,549 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:24:18,552 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 264-304 securityworker stdout | 2021-11-08 14:24:18,553 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 14:24:18,555 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 14:24:18,557 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:24:18,559 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:24:18,562 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:24:18,564 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:24:18,566 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:24:18,569 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:24:18,571 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:24:18,573 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:24:18,575 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:24:18,577 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:24:18,577 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:24:18,663 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:24:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:30 UTC)" (scheduled at 2021-11-08 14:24:20.322052+00:00) notificationworker stdout | 2021-11-08 14:24:20,355 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:24:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:51 UTC)" (scheduled at 2021-11-08 14:24:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:24:21,839 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:24:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:52 UTC)" (scheduled at 2021-11-08 14:24:22.617060+00:00) gcworker stdout | 2021-11-08 14:24:22,691 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:24:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:27 UTC)" (scheduled at 2021-11-08 14:24:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:24:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:27 UTC)" executed successfully securityworker stdout | 2021-11-08 14:24:30,090 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:24:30,090 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:24:30,091 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:24:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:24:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:40 UTC)" (scheduled at 2021-11-08 14:24:30.322052+00:00) notificationworker stdout | 2021-11-08 14:24:30,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:24:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:50 UTC)" (scheduled at 2021-11-08 14:24:40.322052+00:00) notificationworker stdout | 2021-11-08 14:24:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:24:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:24:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.150 325 0.149) gunicorn-registry stdout | 2021-11-08 14:24:47,565 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:24:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:24:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:17 UTC)" (scheduled at 2021-11-08 14:24:47.787050+00:00) securityworker stdout | 2021-11-08 14:24:48,188 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 14:24:48,190 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 14:24:48,261 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:24:48,264 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 239-279 securityworker stdout | 2021-11-08 14:24:48,266 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 14:24:48,269 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:24:48,272 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 14:24:48,274 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 237-277 securityworker stdout | 2021-11-08 14:24:48,277 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:24:48,279 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 14:24:48,282 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 14:24:48,284 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 14:24:48,287 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 14:24:48,289 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:24:48,292 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 14:24:48,295 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 14:24:48,298 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 14:24:48,300 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 14:24:48,303 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 433-464 securityworker stdout | 2021-11-08 14:24:48,303 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:24:48,537 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:24:48,540 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:24:48,543 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 14:24:48,545 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 14:24:48,547 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:24:48,549 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:24:48,551 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 14:24:48,553 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 14:24:48,555 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 14:24:48,557 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 14:24:48,559 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 14:24:48,561 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 14:24:48,563 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:24:48,565 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 14:24:48,567 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 14:24:48,569 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 14:24:48,572 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 14:24:48,575 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 14:24:48,577 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 14:24:48,577 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:24:48,934 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:24:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:00 UTC)" (scheduled at 2021-11-08 14:24:50.322052+00:00) notificationworker stdout | 2021-11-08 14:24:50,343 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:24:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:50 UTC)" (scheduled at 2021-11-08 14:24:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:24:50,411 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:24:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:21 UTC)" (scheduled at 2021-11-08 14:24:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:24:52,069 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:24:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:22 UTC)" (scheduled at 2021-11-08 14:24:52.617060+00:00) gcworker stdout | 2021-11-08 14:24:52,733 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:24:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:54 UTC)" (scheduled at 2021-11-08 14:24:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:24:54,219 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:54 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:24:54 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:24:54,561 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:24:54 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:24:55 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1690 0.019) gunicorn-registry stdout | 2021-11-08 14:24:55,044 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:24:55 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:24:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:55 UTC)" (scheduled at 2021-11-08 14:24:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:24:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:25:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:24:58,456 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:24:58,456 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:24:58,457 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:25:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:10 UTC)" (scheduled at 2021-11-08 14:25:00.322052+00:00) notificationworker stdout | 2021-11-08 14:25:01,800 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:25:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:06 UTC)" (scheduled at 2021-11-08 14:25:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:25:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:25:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:09 UTC)" (scheduled at 2021-11-08 14:25:09.376681+00:00) notificationworker stdout | 2021-11-08 14:25:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:25:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:20 UTC)" (scheduled at 2021-11-08 14:25:10.322052+00:00) notificationworker stdout | 2021-11-08 14:25:10,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:25:11 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.688 193 0.689) gunicorn-web stdout | 2021-11-08 14:25:11,812 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:25:11 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 14:25:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:16 UTC)" (scheduled at 2021-11-08 14:25:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:25:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:25:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:47 UTC)" (scheduled at 2021-11-08 14:25:17.787050+00:00) securityworker stdout | 2021-11-08 14:25:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 14:25:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 14:25:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 98-138 securityworker stdout | 2021-11-08 14:25:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 15-55 securityworker stdout | 2021-11-08 14:25:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:25:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 14:25:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 14:25:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 193-233 securityworker stdout | 2021-11-08 14:25:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 14:25:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:25:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 14:25:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 14:25:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 14:25:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:25:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:25:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 14:25:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 14:25:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 14:25:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 14:25:17,860 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:25:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 14:25:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:25:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:25:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 14:25:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 372-412 securityworker stdout | 2021-11-08 14:25:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 14:25:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:25:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 14:25:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:25:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 14:25:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 14:25:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 14:25:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:25:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 14:25:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 14:25:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 14:25:17,896 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:25:18,150 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:25:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:30 UTC)" (scheduled at 2021-11-08 14:25:20.322052+00:00) notificationworker stdout | 2021-11-08 14:25:20,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:25:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:51 UTC)" (scheduled at 2021-11-08 14:25:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:25:21,926 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:51 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:25:21,932 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:25:21 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:25:21 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (1.408 325 1.408) gcworker stdout | 2021-11-08 14:25:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:52 UTC)" (scheduled at 2021-11-08 14:25:22.617060+00:00) gcworker stdout | 2021-11-08 14:25:22,988 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:52 UTC)" executed successfully securityworker stdout | 2021-11-08 14:25:27,778 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:25:27,778 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:25:27,779 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:25:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:25:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:27 UTC)" (scheduled at 2021-11-08 14:25:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:25:27,935 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:25:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:40 UTC)" (scheduled at 2021-11-08 14:25:30.322052+00:00) notificationworker stdout | 2021-11-08 14:25:30,676 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:25:33 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.521 407 1.521) gunicorn-web stdout | 2021-11-08 14:25:33,629 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:25:33 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:25:37 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:25:37,335 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:25:37 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:25:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:50 UTC)" (scheduled at 2021-11-08 14:25:40.322052+00:00) notificationworker stdout | 2021-11-08 14:25:41,044 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:25:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:25:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:17 UTC)" (scheduled at 2021-11-08 14:25:47.787050+00:00) securityworker stdout | 2021-11-08 14:25:48,658 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 398-438 securityworker stdout | 2021-11-08 14:25:48,660 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 14:25:48,663 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 121-161 securityworker stdout | 2021-11-08 14:25:48,665 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 161-201 securityworker stdout | 2021-11-08 14:25:48,667 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:25:48,669 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:25:48,671 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 14:25:48,673 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:25:48,675 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:25:48,677 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 14:25:48,679 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:25:48,681 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 14:25:48,684 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 14:25:48,686 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 307-347 securityworker stdout | 2021-11-08 14:25:48,688 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 14:25:48,690 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 438-464 securityworker stdout | 2021-11-08 14:25:48,691 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:25:48,693 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:25:48,696 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:25:48,698 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:25:48,701 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:25:48,703 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 14:25:48,706 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:25:48,709 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 14:25:48,713 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 14:25:48,716 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 14:25:48,719 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:25:48,729 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:25:48,732 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 14:25:48,735 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:25:48,738 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:25:48,740 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 14:25:48,743 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 14:25:48,745 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 14:25:48,748 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 14:25:48,750 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 14:25:48,750 [102] [INFO] [util.migrate.allocator] No more work exportactionlogsworker stdout | 2021-11-08 14:25:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:30:49 UTC)" (scheduled at 2021-11-08 14:25:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 14:25:50,070 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:30:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:25:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:00 UTC)" (scheduled at 2021-11-08 14:25:50.322052+00:00) securityworker stdout | 2021-11-08 14:25:50,328 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:25:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:25:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:50 UTC)" (scheduled at 2021-11-08 14:25:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:25:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:25:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:21 UTC)" (scheduled at 2021-11-08 14:25:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:25:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:25:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:22 UTC)" (scheduled at 2021-11-08 14:25:52.617060+00:00) gcworker stdout | 2021-11-08 14:25:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:25:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:54 UTC)" (scheduled at 2021-11-08 14:25:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:25:54,188 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:25:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:55 UTC)" (scheduled at 2021-11-08 14:25:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:25:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:26:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:25:58,357 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:25:58,358 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:25:58,358 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:26:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:10 UTC)" (scheduled at 2021-11-08 14:26:00.322052+00:00) notificationworker stdout | 2021-11-08 14:26:00,786 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:26:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:06 UTC)" (scheduled at 2021-11-08 14:26:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:26:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:07 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:26:07,499 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:07 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:08 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1689 0.019) gunicorn-registry stdout | 2021-11-08 14:26:08,164 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:08 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:26:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:09 UTC)" (scheduled at 2021-11-08 14:26:09.376681+00:00) notificationworker stdout | 2021-11-08 14:26:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:26:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:20 UTC)" (scheduled at 2021-11-08 14:26:10.322052+00:00) notificationworker stdout | 2021-11-08 14:26:10,518 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:26:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:16 UTC)" (scheduled at 2021-11-08 14:26:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:26:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:26:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:47 UTC)" (scheduled at 2021-11-08 14:26:17.787050+00:00) securityworker stdout | 2021-11-08 14:26:17,929 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 14:26:17,969 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 340-380 securityworker stdout | 2021-11-08 14:26:17,971 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:26:17,974 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 14:26:17,976 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 14:26:17,979 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:26:17,981 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 14:26:17,983 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 288-328 securityworker stdout | 2021-11-08 14:26:17,985 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 14:26:17,987 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 14:26:17,989 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:26:17,991 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 14:26:17,994 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:26:17,996 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 14:26:17,998 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:26:18,000 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 14:26:18,003 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 14:26:18,004 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 380-420 securityworker stdout | 2021-11-08 14:26:18,005 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:26:18,007 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 312-352 securityworker stdout | 2021-11-08 14:26:18,009 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 121-161 securityworker stdout | 2021-11-08 14:26:18,011 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 14:26:18,013 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:26:18,015 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 14:26:18,017 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 161-201 securityworker stdout | 2021-11-08 14:26:18,020 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:26:18,022 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 35-75 securityworker stdout | 2021-11-08 14:26:18,024 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 77-117 securityworker stdout | 2021-11-08 14:26:18,026 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 14:26:18,028 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 14:26:18,030 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 387-427 securityworker stdout | 2021-11-08 14:26:18,032 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 14:26:18,034 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:26:18,036 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 427-464 securityworker stdout | 2021-11-08 14:26:18,036 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:26:18,454 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 14:26:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:30 UTC)" (scheduled at 2021-11-08 14:26:20.322052+00:00) notificationworker stdout | 2021-11-08 14:26:20,644 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:26:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:51 UTC)" (scheduled at 2021-11-08 14:26:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:26:21,834 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:26:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:52 UTC)" (scheduled at 2021-11-08 14:26:22.617060+00:00) gcworker stdout | 2021-11-08 14:26:23,154 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:26:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:27 UTC)" (scheduled at 2021-11-08 14:26:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:26:27,912 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:27 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:26:29 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.318 325 0.318) gunicorn-registry stdout | 2021-11-08 14:26:29,812 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:26:29 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:26:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:40 UTC)" (scheduled at 2021-11-08 14:26:30.322052+00:00) notificationworker stdout | 2021-11-08 14:26:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:26:30,508 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:26:30,508 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:26:30,509 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:26:47 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:30 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.945 407 0.945) gunicorn-web stdout | 2021-11-08 14:26:30,554 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:30 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:26:35,496 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:36 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.166 430 1.166) gunicorn-web stdout | 2021-11-08 14:26:36,471 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:36 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:37 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.048 1690 0.020) gunicorn-registry stdout | 2021-11-08 14:26:37,597 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:37 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.293 448 0.293) gunicorn-web stdout | 2021-11-08 14:26:39,352 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.513 89 0.513) gunicorn-web stdout | 2021-11-08 14:26:39,572 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.514 78 0.514) gunicorn-web stdout | 2021-11-08 14:26:39,573 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.568 91 0.568) gunicorn-web stdout | 2021-11-08 14:26:39,627 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.678 92 0.678) gunicorn-web stdout | 2021-11-08 14:26:39,738 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:39 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:26:40 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.467 325 0.467) gunicorn-registry stdout | 2021-11-08 14:26:40,187 [235] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:26:40 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:26:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:50 UTC)" (scheduled at 2021-11-08 14:26:40.322052+00:00) notificationworker stdout | 2021-11-08 14:26:40,351 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:26:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:41 +0000] "GET /api/v1/repository/finacle10225/fincore?includeStats=true&includeTags=false HTTP/2.0" 200 3632 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.058 414 0.058) gunicorn-web stdout | 2021-11-08 14:26:41,930 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:41 +0000] "GET /api/v1/repository/finacle10225/fincore?includeStats=true&includeTags=false HTTP/1.0" 200 3632 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:41 +0000] "GET /api/v1/repository/finacle10225/fincore/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.067 472 0.067) gunicorn-web stdout | 2021-11-08 14:26:41,939 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:41 +0000] "GET /api/v1/repository/finacle10225/fincore/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:42 +0000] "GET /api/v1/repository/finacle10225/fincore/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.056 404 0.055) gunicorn-web stdout | 2021-11-08 14:26:42,618 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:42 +0000] "GET /api/v1/repository/finacle10225/fincore/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:44 +0000] "GET /api/v1/repository/finacle10225/fincore/manifest/sha256:7595564e7baaebdbb32ec49fc7ecb0df048d817444b1fa110ebc7456f0e96b23/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.248 127 0.248) gunicorn-web stdout | 2021-11-08 14:26:44,262 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:44 +0000] "GET /api/v1/repository/finacle10225/fincore/manifest/sha256:7595564e7baaebdbb32ec49fc7ecb0df048d817444b1fa110ebc7456f0e96b23/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:26:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:17 UTC)" (scheduled at 2021-11-08 14:26:47.787050+00:00) securityworker stdout | 2021-11-08 14:26:47,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:26:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:26:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:26:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:26:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 14:26:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 37-77 securityworker stdout | 2021-11-08 14:26:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:26:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 148-188 securityworker stdout | 2021-11-08 14:26:48,782 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:26:48,785 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 14:26:48,788 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 14:26:48,791 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 14:26:48,794 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 14:26:48,797 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 77-117 securityworker stdout | 2021-11-08 14:26:48,800 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:26:48,803 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 14:26:48,803 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:26:48,807 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 398-438 securityworker stdout | 2021-11-08 14:26:48,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:26:48,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 14:26:48,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 14:26:48,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 392-432 securityworker stdout | 2021-11-08 14:26:48,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 14:26:48,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 14:26:48,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:26:48,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:26:48,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 14:26:48,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 14:26:48,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 14:26:48,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 438-464 securityworker stdout | 2021-11-08 14:26:48,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:26:48,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:26:48,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:26:48,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:26:48,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 14:26:48,850 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:26:48,860 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:26:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:00 UTC)" (scheduled at 2021-11-08 14:26:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:26:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:50 UTC)" (scheduled at 2021-11-08 14:26:50.393684+00:00) notificationworker stdout | 2021-11-08 14:26:50,447 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:26:50,513 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:26:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:21 UTC)" (scheduled at 2021-11-08 14:26:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:26:51,812 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:26:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:22 UTC)" (scheduled at 2021-11-08 14:26:52.617060+00:00) gcworker stdout | 2021-11-08 14:26:52,971 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:26:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:54 UTC)" (scheduled at 2021-11-08 14:26:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:26:54,755 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:26:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:55 UTC)" (scheduled at 2021-11-08 14:26:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:26:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:27:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:56 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:26:56,927 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:56 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-web stdout | 2021-11-08 14:26:57,557 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:57 +0000] "GET /api/v1/repository/finacle10225/fincore/manifest/sha256:9f440142debabce19821a495574462d84eb87492d60c5c9b147a57ab4cef3470/security?vulnerabilities=true HTTP/1.0" 200 946476 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:57 +0000] "GET /api/v1/repository/finacle10225/fincore/manifest/sha256:9f440142debabce19821a495574462d84eb87492d60c5c9b147a57ab4cef3470/security?vulnerabilities=true HTTP/2.0" 200 946476 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (13.616 127 13.542) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:26:57 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.134 1691 0.134) gunicorn-registry stdout | 2021-11-08 14:26:57,994 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:26:57 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:27:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:10 UTC)" (scheduled at 2021-11-08 14:27:00.322052+00:00) notificationworker stdout | 2021-11-08 14:27:00,451 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:10 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:27:00,936 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:00 +0000] "GET /api/v1/repository/finacle10225/fincore/manifest/sha256:b6b7982a48496c2b554c30e01ae01f39bdb93933f1fea1ee5991e1ddce8c2395/security?vulnerabilities=true HTTP/1.0" 200 940679 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:01 +0000] "GET /api/v1/repository/finacle10225/fincore/manifest/sha256:b6b7982a48496c2b554c30e01ae01f39bdb93933f1fea1ee5991e1ddce8c2395/security?vulnerabilities=true HTTP/2.0" 200 940679 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (17.021 126 16.922) gunicorn-web stdout | 2021-11-08 14:27:01,445 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:01 +0000] "GET /api/v1/repository/finacle10225/fincore/manifest/sha256:119bce9e6d7cbc2b637e271c7204dabf2380d93bbb261fd8f4d95c7bb5e44c96/security?vulnerabilities=true HTTP/1.0" 200 946476 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:01 +0000] "GET /api/v1/repository/finacle10225/fincore/manifest/sha256:119bce9e6d7cbc2b637e271c7204dabf2380d93bbb261fd8f4d95c7bb5e44c96/security?vulnerabilities=true HTTP/2.0" 200 946476 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (17.641 601 17.434) securityworker stdout | 2021-11-08 14:27:02,742 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:27:02,742 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:27:02,743 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:17 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:27:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.098 325 0.098) gunicorn-registry stdout | 2021-11-08 14:27:05,400 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:27:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 14:27:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:06 UTC)" (scheduled at 2021-11-08 14:27:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:27:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:27:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:09 UTC)" (scheduled at 2021-11-08 14:27:09.376681+00:00) notificationworker stdout | 2021-11-08 14:27:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:27:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:20 UTC)" (scheduled at 2021-11-08 14:27:10.322052+00:00) notificationworker stdout | 2021-11-08 14:27:10,380 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:12 +0000] "GET /api/v1/repository/finacle10225/fincore/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.057 404 0.056) gunicorn-web stdout | 2021-11-08 14:27:12,796 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:12 +0000] "GET /api/v1/repository/finacle10225/fincore/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 14:27:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:16 UTC)" (scheduled at 2021-11-08 14:27:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:27:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:16 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:17 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:27:17,610 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:17 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:27:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:47 UTC)" (scheduled at 2021-11-08 14:27:17.787050+00:00) securityworker stdout | 2021-11-08 14:27:17,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 14:27:17,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:27:17,927 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 14:27:17,929 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:27:17,931 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:27:17,933 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:27:17,935 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 14:27:17,937 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 14:27:17,939 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 14:27:17,941 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 14:27:17,943 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:27:17,945 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:27:17,947 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 14:27:17,949 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 14:27:17,951 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:27:17,952 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 14:27:17,952 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:27:17,955 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:27:17,957 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 14:27:17,959 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 57-97 securityworker stdout | 2021-11-08 14:27:17,961 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:27:17,963 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:27:17,965 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 14:27:17,967 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:27:17,968 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 14:27:17,970 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:27:17,972 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:27:17,974 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 15-55 securityworker stdout | 2021-11-08 14:27:17,976 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 14:27:17,978 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 14:27:17,980 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 14:27:17,981 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:27:17,983 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 14:27:17,985 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 435-464 securityworker stdout | 2021-11-08 14:27:17,985 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:27:18,307 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.018 1690 0.018) gunicorn-registry stdout | 2021-11-08 14:27:18,371 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:27:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:30 UTC)" (scheduled at 2021-11-08 14:27:20.322052+00:00) notificationworker stdout | 2021-11-08 14:27:20,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:27:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:51 UTC)" (scheduled at 2021-11-08 14:27:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:27:21,816 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:27:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:52 UTC)" (scheduled at 2021-11-08 14:27:22.617060+00:00) gcworker stdout | 2021-11-08 14:27:23,262 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:24 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.062 47 0.062) gunicorn-web stdout | 2021-11-08 14:27:24,922 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:24 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:24 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.066 407 0.066) gunicorn-web stdout | 2021-11-08 14:27:24,926 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:24 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:27:26,214 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.047 92 0.047) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.162 78 0.162) gunicorn-web stdout | 2021-11-08 14:27:26,330 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:27:26,357 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:27:26,358 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.190 448 0.190) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.190 89 0.190) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.287 91 0.287) gunicorn-web stdout | 2021-11-08 14:27:26,456 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:26 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:27:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:27 UTC)" (scheduled at 2021-11-08 14:27:27.884604+00:00) securityworker stdout | 2021-11-08 14:27:27,903 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:27:27,903 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:27:27,904 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:27:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:27:27,924 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:27 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:27:28,418 [230] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} gunicorn-registry stdout | 2021-11-08 14:27:28,420 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:28 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:28 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:28 +0000] "GET /api/v1/repository/finacle10225/finaclecrm?includeStats=true&includeTags=false HTTP/2.0" 200 3635 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.103 416 0.103) gunicorn-web stdout | 2021-11-08 14:27:28,850 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:28 +0000] "GET /api/v1/repository/finacle10225/finaclecrm?includeStats=true&includeTags=false HTTP/1.0" 200 3635 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:27:28,870 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:28 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:28 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.124 475 0.124) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:29 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.040 408 0.040) gunicorn-web stdout | 2021-11-08 14:27:29,470 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:29 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:27:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:40 UTC)" (scheduled at 2021-11-08 14:27:30.322052+00:00) notificationworker stdout | 2021-11-08 14:27:30,622 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:27:31 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.391 325 0.391) gunicorn-registry stdout | 2021-11-08 14:27:31,919 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:27:31 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:32 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:27:32,384 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:32 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:32 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1692 0.015) gunicorn-registry stdout | 2021-11-08 14:27:32,544 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:32 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:32 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.027 475 0.027) gunicorn-web stdout | 2021-11-08 14:27:32,625 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:32 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:27:32,641 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:32 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:27:32,642 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:32 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:27:32,644 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:32 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:32 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.045 92 0.045) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:32 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.043 89 0.043) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:32 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.040 91 0.040) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:33 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.809 92 0.809) gunicorn-web stdout | 2021-11-08 14:27:33,414 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:33 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:36 +0000] "GET /api/v1/repository/finacle10225/finaclecrm?includeStats=true&includeTags=false HTTP/2.0" 200 3635 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.040 76 0.040) gunicorn-web stdout | 2021-11-08 14:27:36,399 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:36 +0000] "GET /api/v1/repository/finacle10225/finaclecrm?includeStats=true&includeTags=false HTTP/1.0" 200 3635 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:36 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.047 425 0.047) gunicorn-web stdout | 2021-11-08 14:27:36,406 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:36 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:36 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.043 407 0.043) gunicorn-web stdout | 2021-11-08 14:27:36,978 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:36 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:27:38,061 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:38 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:bcb4a3e6e27c441ccb318e96569343890341fb7289f38b9b93537b798489e006/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:38 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:bcb4a3e6e27c441ccb318e96569343890341fb7289f38b9b93537b798489e006/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.127 130 0.126) notificationworker stdout | 2021-11-08 14:27:40,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:50 UTC)" (scheduled at 2021-11-08 14:27:40.322052+00:00) notificationworker stdout | 2021-11-08 14:27:40,346 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:27:50 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:27:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:32:46 UTC)" (scheduled at 2021-11-08 14:27:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:27:46,153 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:32:46 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:27:46,531 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:46 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:8eb18624aa86ddabecefe4e882c45bad241dcac6d32b5379defb649ec9f239d2/security?vulnerabilities=true HTTP/1.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:46 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:8eb18624aa86ddabecefe4e882c45bad241dcac6d32b5379defb649ec9f239d2/security?vulnerabilities=true HTTP/2.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (8.696 129 8.591) securityworker stdout | 2021-11-08 14:27:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:17 UTC)" (scheduled at 2021-11-08 14:27:47.787050+00:00) securityworker stdout | 2021-11-08 14:27:47,809 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 14:27:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 14:27:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 14:27:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 14:27:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 14:27:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 14:27:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 269-309 gunicorn-web stdout | 2021-11-08 14:27:47,829 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:47 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:aac68378af914022798fffa1d9fa66866647f0160cc8cf8ee62d13b10e510358/security?vulnerabilities=true HTTP/1.0" 200 944287 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:27:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 gunicorn-web stdout | 2021-11-08 14:27:47,833 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:27:47 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:cbccbf418c361d7484e9277dcb0839e75c5603159574d3e1f07020de2bb9a6b7/security?vulnerabilities=true HTTP/1.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:27:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 14:27:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:27:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:27:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 14:27:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:27:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 436-464 securityworker stdout | 2021-11-08 14:27:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 14:27:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 14:27:47,850 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:27:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 312-352 securityworker stdout | 2021-11-08 14:27:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 14:27:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:27:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:27:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 14:27:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 14:27:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 14:27:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 146-186 securityworker stdout | 2021-11-08 14:27:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 14:27:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 14:27:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 14:27:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 98-138 securityworker stdout | 2021-11-08 14:27:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:27:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:27:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 14:27:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 14:27:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 14:27:47,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 14:27:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 14:27:47,890 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:27:47,899 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:47 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:aac68378af914022798fffa1d9fa66866647f0160cc8cf8ee62d13b10e510358/security?vulnerabilities=true HTTP/2.0" 200 944287 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (10.053 207 9.894) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:27:48 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:cbccbf418c361d7484e9277dcb0839e75c5603159574d3e1f07020de2bb9a6b7/security?vulnerabilities=true HTTP/2.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (10.098 129 9.896) notificationworker stdout | 2021-11-08 14:27:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:00 UTC)" (scheduled at 2021-11-08 14:27:50.322052+00:00) notificationworker stdout | 2021-11-08 14:27:50,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:27:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:50 UTC)" (scheduled at 2021-11-08 14:27:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:27:50,408 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:27:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:21 UTC)" (scheduled at 2021-11-08 14:27:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:27:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:27:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:32:52 UTC)" (scheduled at 2021-11-08 14:27:52.376404+00:00) notificationworker stdout | 2021-11-08 14:27:52,398 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:32:52 UTC)" executed successfully gcworker stdout | 2021-11-08 14:27:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:22 UTC)" (scheduled at 2021-11-08 14:27:52.617060+00:00) gcworker stdout | 2021-11-08 14:27:52,717 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:27:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:54 UTC)" (scheduled at 2021-11-08 14:27:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:27:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:27:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:55 UTC)" (scheduled at 2021-11-08 14:27:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:27:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:28:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:27:55,172 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:27:55,173 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:27:55,173 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:17 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:27:59 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.085 325 0.084) gunicorn-registry stdout | 2021-11-08 14:27:59,616 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:27:59 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:28:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:10 UTC)" (scheduled at 2021-11-08 14:28:00.322052+00:00) notificationworker stdout | 2021-11-08 14:28:00,443 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:28:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:06 UTC)" (scheduled at 2021-11-08 14:28:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:28:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:06 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:28:07,623 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:28:07 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:28:07 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.558 407 0.558) notificationworker stdout | 2021-11-08 14:28:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:09 UTC)" (scheduled at 2021-11-08 14:28:09.376681+00:00) notificationworker stdout | 2021-11-08 14:28:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:28:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:20 UTC)" (scheduled at 2021-11-08 14:28:10.322052+00:00) notificationworker stdout | 2021-11-08 14:28:10,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:28:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:33:14 UTC)" (scheduled at 2021-11-08 14:28:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:28:15,411 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:33:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:28:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:16 UTC)" (scheduled at 2021-11-08 14:28:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:28:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:28:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:47 UTC)" (scheduled at 2021-11-08 14:28:17.787050+00:00) securityworker stdout | 2021-11-08 14:28:18,023 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 14:28:18,026 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 14:28:18,029 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 14:28:18,031 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 14:28:18,033 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 14:28:18,035 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 14:28:18,037 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:28:18,039 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:28:18,041 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:28:18,043 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 14:28:18,049 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 193-233 securityworker stdout | 2021-11-08 14:28:18,091 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:28:18,128 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:28:18,352 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:28:18,354 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 429-464 securityworker stdout | 2021-11-08 14:28:18,354 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:28:18,356 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:28:18,359 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 14:28:18,361 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:28:18,363 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:28:18,364 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 250-290 securityworker stdout | 2021-11-08 14:28:18,366 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:28:18,368 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:28:18,370 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:28:18,372 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:28:18,374 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 14:28:18,376 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:28:18,378 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 14:28:18,380 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 14:28:18,381 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:28:18,383 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:28:18,385 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 14:28:18,387 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:28:18,389 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 14:28:18,391 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 14:28:18,391 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:28:18,848 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:28:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:30 UTC)" (scheduled at 2021-11-08 14:28:20.322052+00:00) notificationworker stdout | 2021-11-08 14:28:20,408 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:28:21,237 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:28:21,237 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:28:21,238 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:28:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:51 UTC)" (scheduled at 2021-11-08 14:28:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:28:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:28:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:52 UTC)" (scheduled at 2021-11-08 14:28:22.617060+00:00) gcworker stdout | 2021-11-08 14:28:22,693 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:28:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:28:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:27 UTC)" (scheduled at 2021-11-08 14:28:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:28:27,917 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:28:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:40 UTC)" (scheduled at 2021-11-08 14:28:30.322052+00:00) notificationworker stdout | 2021-11-08 14:28:30,679 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:28:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:50 UTC)" (scheduled at 2021-11-08 14:28:40.322052+00:00) notificationworker stdout | 2021-11-08 14:28:41,123 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:28:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:28:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:17 UTC)" (scheduled at 2021-11-08 14:28:47.787050+00:00) securityworker stdout | 2021-11-08 14:28:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:28:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:28:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:28:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 14:28:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:28:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:28:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:28:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 14:28:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 14:28:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 14:28:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 14:28:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 14:28:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:28:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 14:28:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:28:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 434-464 securityworker stdout | 2021-11-08 14:28:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 14:28:47,897 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:28:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 232-272 securityworker stdout | 2021-11-08 14:28:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:28:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:28:47,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 192-232 securityworker stdout | 2021-11-08 14:28:47,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 14:28:47,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:28:47,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:28:47,919 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 14:28:47,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:28:47,924 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 14:28:47,926 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 14:28:47,929 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 14:28:47,932 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 14:28:47,935 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 272-312 securityworker stdout | 2021-11-08 14:28:47,939 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 14:28:47,942 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:28:47,945 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 14:28:47,948 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:28:47,951 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:28:47,954 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 372-412 securityworker stdout | 2021-11-08 14:28:47,954 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:28:47,964 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:28:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:00 UTC)" (scheduled at 2021-11-08 14:28:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:28:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:50 UTC)" (scheduled at 2021-11-08 14:28:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:28:50,428 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:28:50,430 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:28:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:21 UTC)" (scheduled at 2021-11-08 14:28:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:28:52,132 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:28:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:22 UTC)" (scheduled at 2021-11-08 14:28:52.617060+00:00) gcworker stdout | 2021-11-08 14:28:52,707 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:28:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:54 UTC)" (scheduled at 2021-11-08 14:28:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:28:54,646 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:28:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:55 UTC)" (scheduled at 2021-11-08 14:28:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:28:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:29:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:28:58,648 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:28:58,649 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:28:58,649 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:29:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:10 UTC)" (scheduled at 2021-11-08 14:29:00.322052+00:00) notificationworker stdout | 2021-11-08 14:29:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:29:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:06 UTC)" (scheduled at 2021-11-08 14:29:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:29:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:29:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:09 UTC)" (scheduled at 2021-11-08 14:29:09.376681+00:00) notificationworker stdout | 2021-11-08 14:29:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:29:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:20 UTC)" (scheduled at 2021-11-08 14:29:10.322052+00:00) notificationworker stdout | 2021-11-08 14:29:10,798 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:20 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:29:11,613 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:29:11 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:29:11 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:29:11 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.216 325 0.216) gunicorn-registry stdout | 2021-11-08 14:29:11,853 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:29:11 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:29:11 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.060 1690 0.060) gunicorn-registry stdout | 2021-11-08 14:29:11,940 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:29:11 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 14:29:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:16 UTC)" (scheduled at 2021-11-08 14:29:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:29:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:29:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:47 UTC)" (scheduled at 2021-11-08 14:29:17.787050+00:00) securityworker stdout | 2021-11-08 14:29:19,203 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:29:19,223 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 14:29:19,226 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 14:29:19,228 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:29:19,230 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 26-66 securityworker stdout | 2021-11-08 14:29:19,232 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 14:29:19,253 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:29:19,255 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 14:29:19,257 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:29:19,260 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 14:29:19,263 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 14:29:19,266 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 434-464 securityworker stdout | 2021-11-08 14:29:19,268 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:29:19,270 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 14:29:19,272 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 14:29:19,272 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:29:19,275 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 14:29:19,278 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 14:29:19,280 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 14:29:19,282 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 14:29:19,284 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 14:29:19,287 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:29:19,291 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:29:19,294 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:29:19,298 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 14:29:19,326 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:29:19,329 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 14:29:19,331 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 14:29:19,334 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 14:29:19,337 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 264-304 securityworker stdout | 2021-11-08 14:29:19,339 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 460-464 securityworker stdout | 2021-11-08 14:29:19,341 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 14:29:19,344 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 14:29:19,344 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:29:19,355 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:29:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:30 UTC)" (scheduled at 2021-11-08 14:29:20.322052+00:00) notificationworker stdout | 2021-11-08 14:29:20,365 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:29:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:51 UTC)" (scheduled at 2021-11-08 14:29:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:29:21,944 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:29:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:52 UTC)" (scheduled at 2021-11-08 14:29:22.617060+00:00) gcworker stdout | 2021-11-08 14:29:22,644 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:29:23 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:29:23,013 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:29:23 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:29:23,289 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:29:23 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:29:23 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.184 325 0.184) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:29:23 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1689 0.017) gunicorn-registry stdout | 2021-11-08 14:29:23,374 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:29:23 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:29:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:27 UTC)" (scheduled at 2021-11-08 14:29:27.884604+00:00) securityworker stdout | 2021-11-08 14:29:28,005 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:29:28,005 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:29:28,006 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:29:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:29:28,292 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:29:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:40 UTC)" (scheduled at 2021-11-08 14:29:30.322052+00:00) notificationworker stdout | 2021-11-08 14:29:30,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:29:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:50 UTC)" (scheduled at 2021-11-08 14:29:40.322052+00:00) notificationworker stdout | 2021-11-08 14:29:40,352 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:29:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:29:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:17 UTC)" (scheduled at 2021-11-08 14:29:47.787050+00:00) securityworker stdout | 2021-11-08 14:29:48,062 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:29:48,065 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 19-59 securityworker stdout | 2021-11-08 14:29:48,067 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 14:29:48,070 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:29:48,073 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 14:29:48,075 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:29:48,077 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:29:48,079 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:29:48,081 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 82-122 securityworker stdout | 2021-11-08 14:29:48,083 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 14:29:48,085 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 14:29:48,087 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 14:29:48,089 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:29:48,091 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 425-464 securityworker stdout | 2021-11-08 14:29:48,093 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 204-244 securityworker stdout | 2021-11-08 14:29:48,095 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 14:29:48,096 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:29:48,098 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 14:29:48,100 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 14:29:48,102 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:29:48,104 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:29:48,106 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 14:29:48,108 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:29:48,110 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:29:48,112 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 14:29:48,114 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:29:48,116 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 14:29:48,118 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:29:48,120 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 14:29:48,123 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 14:29:48,126 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 14:29:48,129 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 14:29:48,131 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:29:48,134 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 14:29:48,137 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 451-464 securityworker stdout | 2021-11-08 14:29:48,137 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:29:48,147 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:29:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:00 UTC)" (scheduled at 2021-11-08 14:29:50.322052+00:00) notificationworker stdout | 2021-11-08 14:29:50,391 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:29:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:50 UTC)" (scheduled at 2021-11-08 14:29:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:29:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:29:51,274 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:29:51,275 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:29:51,276 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:29:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:21 UTC)" (scheduled at 2021-11-08 14:29:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:29:51,872 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:29:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:22 UTC)" (scheduled at 2021-11-08 14:29:52.617060+00:00) gcworker stdout | 2021-11-08 14:29:52,659 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:29:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:54 UTC)" (scheduled at 2021-11-08 14:29:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:29:54,256 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:54 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:29:54 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:29:54,287 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:29:54 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:29:54 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.182 325 0.182) gunicorn-registry stdout | 2021-11-08 14:29:54,487 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:29:54 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:29:54 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.015) gunicorn-registry stdout | 2021-11-08 14:29:54,519 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:29:54 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:29:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:55 UTC)" (scheduled at 2021-11-08 14:29:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:29:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:30:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:30:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:10 UTC)" (scheduled at 2021-11-08 14:30:00.322052+00:00) notificationworker stdout | 2021-11-08 14:30:00,382 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:30:05 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:30:05,509 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:30:05 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:30:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.124 325 0.124) gunicorn-registry stdout | 2021-11-08 14:30:05,656 [241] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:30:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:30:05 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.060 1690 0.060) gunicorn-registry stdout | 2021-11-08 14:30:05,735 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:30:05 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 14:30:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:06 UTC)" (scheduled at 2021-11-08 14:30:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:30:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:30:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:09 UTC)" (scheduled at 2021-11-08 14:30:09.376681+00:00) notificationworker stdout | 2021-11-08 14:30:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:30:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:20 UTC)" (scheduled at 2021-11-08 14:30:10.322052+00:00) notificationworker stdout | 2021-11-08 14:30:10,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:30:16,907 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:16 UTC)" (scheduled at 2021-11-08 14:30:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:30:16,907 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:30:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:47 UTC)" (scheduled at 2021-11-08 14:30:17.787050+00:00) securityworker stdout | 2021-11-08 14:30:18,114 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 14:30:18,116 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 14:30:18,118 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 14:30:18,120 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:30:18,251 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 14:30:18,254 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:30:18,257 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 14:30:18,260 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 14:30:18,262 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 14:30:18,264 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 380-420 securityworker stdout | 2021-11-08 14:30:18,267 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 14:30:18,269 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 14:30:18,271 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 294-334 securityworker stdout | 2021-11-08 14:30:18,332 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:30:18,335 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 14:30:18,337 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 14:30:18,337 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:30:18,366 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 14:30:18,368 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 14:30:18,370 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 158-198 securityworker stdout | 2021-11-08 14:30:18,372 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:30:18,374 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 14:30:18,377 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 14:30:18,379 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:30:18,381 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:30:18,383 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 14:30:18,386 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 14:30:18,388 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:30:18,390 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:30:18,392 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 14:30:18,394 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:30:18,397 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 14:30:18,400 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 14:30:18,402 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:30:18,405 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:30:18,405 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:30:18,413 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:30:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:30 UTC)" (scheduled at 2021-11-08 14:30:20.322052+00:00) notificationworker stdout | 2021-11-08 14:30:20,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:30:21,318 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:30:21,319 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:30:21,320 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:30:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:51 UTC)" (scheduled at 2021-11-08 14:30:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:30:21,821 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:30:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:52 UTC)" (scheduled at 2021-11-08 14:30:22.617060+00:00) gcworker stdout | 2021-11-08 14:30:22,710 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:30:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:30:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:27 UTC)" (scheduled at 2021-11-08 14:30:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:30:27,911 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:30:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:40 UTC)" (scheduled at 2021-11-08 14:30:30.322052+00:00) notificationworker stdout | 2021-11-08 14:30:30,401 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:30:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:30:35,498 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:30:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:30:36,044 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:30:36 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:30:36 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.526 325 0.526) gunicorn-registry stdout | 2021-11-08 14:30:36,086 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:30:36 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:30:36 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) notificationworker stdout | 2021-11-08 14:30:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:50 UTC)" (scheduled at 2021-11-08 14:30:40.322052+00:00) notificationworker stdout | 2021-11-08 14:30:40,501 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:30:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:30:45 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.487 408 0.486) gunicorn-web stdout | 2021-11-08 14:30:45,714 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:30:45 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:30:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:17 UTC)" (scheduled at 2021-11-08 14:30:47.787050+00:00) securityworker stdout | 2021-11-08 14:30:48,324 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 14:30:48,328 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:30:48,330 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 14:30:48,333 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 14:30:48,336 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:30:48 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:30:48,336 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:30:48 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:30:48,338 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 14:30:48,340 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 34-74 securityworker stdout | 2021-11-08 14:30:48,343 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:30:48,345 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 gunicorn-registry stdout | 2021-11-08 14:30:48,347 [244] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} securityworker stdout | 2021-11-08 14:30:48,348 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 gunicorn-registry stdout | 2021-11-08 14:30:48,349 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:30:48 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:30:48 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) securityworker stdout | 2021-11-08 14:30:48,351 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:30:48,354 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:30:48,357 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:30:48,359 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:30:48,361 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:30:48,363 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:30:48,365 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 14:30:48,367 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:30:48,367 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:30:48,370 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 33-73 securityworker stdout | 2021-11-08 14:30:48,373 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 353-393 securityworker stdout | 2021-11-08 14:30:48,375 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:30:48,378 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 14:30:48,381 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:30:48,383 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:30:48,386 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:30:48,389 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 14:30:48,391 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 193-233 securityworker stdout | 2021-11-08 14:30:48,393 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 14:30:48,396 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:30:48,399 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:30:48,402 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 14:30:48,405 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 14:30:48,407 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 14:30:48,410 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 14:30:48,412 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:30:48,413 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:30:48,622 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 14:30:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:35:49 UTC)" (scheduled at 2021-11-08 14:30:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 14:30:49,459 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:35:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:30:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:00 UTC)" (scheduled at 2021-11-08 14:30:50.322052+00:00) notificationworker stdout | 2021-11-08 14:30:50,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:30:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:50 UTC)" (scheduled at 2021-11-08 14:30:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:30:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:30:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:21 UTC)" (scheduled at 2021-11-08 14:30:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:30:51,815 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:30:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:22 UTC)" (scheduled at 2021-11-08 14:30:52.617060+00:00) gcworker stdout | 2021-11-08 14:30:52,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:30:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:54 UTC)" (scheduled at 2021-11-08 14:30:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:30:54,186 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:30:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:55 UTC)" (scheduled at 2021-11-08 14:30:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:30:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:31:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:30:56,681 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:30:56,681 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:30:56,681 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:31:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:10 UTC)" (scheduled at 2021-11-08 14:31:00.322052+00:00) notificationworker stdout | 2021-11-08 14:31:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:31:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:06 UTC)" (scheduled at 2021-11-08 14:31:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:31:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:31:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:09 UTC)" (scheduled at 2021-11-08 14:31:09.376681+00:00) notificationworker stdout | 2021-11-08 14:31:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:31:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:20 UTC)" (scheduled at 2021-11-08 14:31:10.322052+00:00) notificationworker stdout | 2021-11-08 14:31:10,382 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:31:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:16 UTC)" (scheduled at 2021-11-08 14:31:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:31:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:16 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:31:17 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:31:17,501 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:31:17 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:31:17,621 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:31:17 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:31:17 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.096 325 0.096) securityworker stdout | 2021-11-08 14:31:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:47 UTC)" (scheduled at 2021-11-08 14:31:17.787050+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:31:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.410 1689 0.410) gunicorn-registry stdout | 2021-11-08 14:31:18,053 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:31:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:31:18,119 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 14:31:18,137 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:31:18,139 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 14:31:18,142 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 14:31:18,144 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:31:18,147 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 14:31:18,150 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:31:18,152 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:31:18,154 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:31:18,156 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:31:18,158 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:31:18,160 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 14:31:18,162 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 14:31:18,164 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 14:31:18,166 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 14:31:18,168 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 10-50 securityworker stdout | 2021-11-08 14:31:18,170 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 428-464 securityworker stdout | 2021-11-08 14:31:18,173 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:31:18,173 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:31:18,176 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 14:31:18,179 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:31:18,182 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 14:31:18,184 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 192-232 securityworker stdout | 2021-11-08 14:31:18,186 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:31:18,188 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 14:31:18,190 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 14:31:18,192 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 14:31:18,194 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:31:18,197 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:31:18,199 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 14:31:18,201 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 14:31:18,203 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 232-272 securityworker stdout | 2021-11-08 14:31:18,206 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:31:18,209 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 14:31:18,211 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 443-464 securityworker stdout | 2021-11-08 14:31:18,214 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 14:31:18,216 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 14:31:18,216 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:31:18,225 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:31:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:30 UTC)" (scheduled at 2021-11-08 14:31:20.322052+00:00) notificationworker stdout | 2021-11-08 14:31:20,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:31:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:51 UTC)" (scheduled at 2021-11-08 14:31:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:31:22,136 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:31:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:52 UTC)" (scheduled at 2021-11-08 14:31:22.617060+00:00) gcworker stdout | 2021-11-08 14:31:22,642 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:52 UTC)" executed successfully securityworker stdout | 2021-11-08 14:31:24,392 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:31:24,392 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:31:24,393 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:31:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:31:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:27 UTC)" (scheduled at 2021-11-08 14:31:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:31:27,902 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:31:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:40 UTC)" (scheduled at 2021-11-08 14:31:30.322052+00:00) notificationworker stdout | 2021-11-08 14:31:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:31:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:50 UTC)" (scheduled at 2021-11-08 14:31:40.322052+00:00) notificationworker stdout | 2021-11-08 14:31:40,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:31:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:31:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:31:42,385 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:31:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:31:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.007 228 0.007) gunicorn-registry stdout | 2021-11-08 14:31:42,501 [233] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:31:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:31:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.270 325 0.270) gunicorn-registry stdout | 2021-11-08 14:31:42,674 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:31:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:31:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) gunicorn-registry stdout | 2021-11-08 14:31:42,710 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:31:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:31:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.235 325 0.235) gunicorn-registry stdout | 2021-11-08 14:31:42,754 [232] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:31:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:31:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1690 0.017) gunicorn-registry stdout | 2021-11-08 14:31:42,790 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:31:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:31:47 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:31:47,494 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:31:47 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:31:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.088 325 0.088) gunicorn-registry stdout | 2021-11-08 14:31:47,605 [232] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:31:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:31:47 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) gunicorn-registry stdout | 2021-11-08 14:31:47,644 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:31:47 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:31:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:17 UTC)" (scheduled at 2021-11-08 14:31:47.787050+00:00) securityworker stdout | 2021-11-08 14:31:48,392 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 14:31:48,396 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 442-464 securityworker stdout | 2021-11-08 14:31:48,399 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 199-239 securityworker stdout | 2021-11-08 14:31:48,402 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 277-317 securityworker stdout | 2021-11-08 14:31:48,405 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 239-279 securityworker stdout | 2021-11-08 14:31:48,407 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 14:31:48,409 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 14:31:48,412 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 29-69 securityworker stdout | 2021-11-08 14:31:48,415 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:31:48,417 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 14:31:48,420 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 14:31:48,422 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:31:48,424 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 14:31:48,426 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 14:31:48,428 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 14:31:48,430 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 14:31:48,430 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:31:48,432 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 14:31:48,435 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:31:48,437 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:31:48,439 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:31:48,440 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 14:31:48,442 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 204-244 securityworker stdout | 2021-11-08 14:31:48,445 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:31:48,447 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:31:48,449 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:31:48,452 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:31:48,455 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:31:48,458 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:31:48,461 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 14:31:48,463 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:31:48,466 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 460-464 securityworker stdout | 2021-11-08 14:31:48,466 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:31:48,511 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:31:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:00 UTC)" (scheduled at 2021-11-08 14:31:50.322052+00:00) notificationworker stdout | 2021-11-08 14:31:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:31:50,395 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:50 UTC)" (scheduled at 2021-11-08 14:31:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:31:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:31:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:21 UTC)" (scheduled at 2021-11-08 14:31:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:31:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:31:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:22 UTC)" (scheduled at 2021-11-08 14:31:52.617060+00:00) gcworker stdout | 2021-11-08 14:31:52,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:31:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:54 UTC)" (scheduled at 2021-11-08 14:31:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:31:54,268 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:31:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:55 UTC)" (scheduled at 2021-11-08 14:31:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:31:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:32:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:31:57,670 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:31:57,671 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:31:57,671 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:32:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:10 UTC)" (scheduled at 2021-11-08 14:32:00.322052+00:00) notificationworker stdout | 2021-11-08 14:32:00,609 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:03 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.003) gunicorn-registry stdout | 2021-11-08 14:32:03,924 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:03 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:32:04,026 [238] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:32:04 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:32:04 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.085 325 0.085) gunicorn-registry stdout | 2021-11-08 14:32:04,060 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:04 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:04 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1691 0.017) exportactionlogsworker stdout | 2021-11-08 14:32:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:06 UTC)" (scheduled at 2021-11-08 14:32:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:32:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:07 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:32:07,276 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:07 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:32:07 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.076 325 0.076) gunicorn-registry stdout | 2021-11-08 14:32:07,374 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:32:07 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:07 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1690 0.014) gunicorn-registry stdout | 2021-11-08 14:32:07,407 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:07 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:32:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:09 UTC)" (scheduled at 2021-11-08 14:32:09.376681+00:00) notificationworker stdout | 2021-11-08 14:32:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:32:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:20 UTC)" (scheduled at 2021-11-08 14:32:10.322052+00:00) notificationworker stdout | 2021-11-08 14:32:10,348 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:32:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:16 UTC)" (scheduled at 2021-11-08 14:32:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:32:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:32:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:47 UTC)" (scheduled at 2021-11-08 14:32:17.787050+00:00) securityworker stdout | 2021-11-08 14:32:18,229 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:32:18,255 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 14:32:18,288 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:32:18,303 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 14:32:18,369 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 14:32:18,372 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:32:18,374 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 14:32:18,376 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:32:18,378 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 23-63 securityworker stdout | 2021-11-08 14:32:18,380 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 14:32:18,382 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:32:18,384 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:32:18,386 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:32:18,389 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:32:18,391 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:32:18,391 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:32:18,393 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:32:18,395 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 26-66 securityworker stdout | 2021-11-08 14:32:18,397 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:32:18,399 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 14:32:18,401 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 14:32:18,403 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 14:32:18,406 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 14:32:18,408 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:32:18,410 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 14:32:18,412 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 14:32:18,414 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 14:32:18,416 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 398-438 securityworker stdout | 2021-11-08 14:32:18,418 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 14:32:18,420 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 14:32:18,422 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:32:18,425 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 438-464 securityworker stdout | 2021-11-08 14:32:18,426 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:32:18,426 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:32:18,435 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:32:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:30 UTC)" (scheduled at 2021-11-08 14:32:20.322052+00:00) notificationworker stdout | 2021-11-08 14:32:20,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:32:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:51 UTC)" (scheduled at 2021-11-08 14:32:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:32:21,811 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:32:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:52 UTC)" (scheduled at 2021-11-08 14:32:22.617060+00:00) gcworker stdout | 2021-11-08 14:32:22,650 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:26 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.003) gunicorn-registry stdout | 2021-11-08 14:32:26,698 [232] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:26 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:32:27,097 [240] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:32:27 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:32:27 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.278 325 0.278) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:27 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) gunicorn-registry stdout | 2021-11-08 14:32:27,233 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:27 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:27 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.117 384 0.117) gunicorn-web stdout | 2021-11-08 14:32:27,419 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:27 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:32:27,419 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:27 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:27 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.118 387 0.118) namespacegcworker stdout | 2021-11-08 14:32:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:27 UTC)" (scheduled at 2021-11-08 14:32:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:32:27,917 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:32:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:40 UTC)" (scheduled at 2021-11-08 14:32:30.322052+00:00) notificationworker stdout | 2021-11-08 14:32:30,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:36 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:32:36,494 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:36 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:32:36 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.085 325 0.085) gunicorn-registry stdout | 2021-11-08 14:32:36,598 [239] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:32:36 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:36 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.015) gunicorn-registry stdout | 2021-11-08 14:32:36,633 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:36 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:32:38,475 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:32:38,475 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:32:38,476 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:32:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:32:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:50 UTC)" (scheduled at 2021-11-08 14:32:40.322052+00:00) notificationworker stdout | 2021-11-08 14:32:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:32:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:40 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 14:32:40,416 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:40 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:32:40,427 [242] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:40 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) gunicorn-registry stdout | 2021-11-08 14:32:40,429 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:40 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:41 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:32:41,383 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:41 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:32:41,498 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:32:41 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:32:41 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.094 325 0.094) gunicorn-registry stdout | 2021-11-08 14:32:41,533 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:32:41 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:32:41 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.018 1692 0.018) namespacegcworker stdout | 2021-11-08 14:32:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:37:46 UTC)" (scheduled at 2021-11-08 14:32:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:32:46,149 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:37:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:32:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:17 UTC)" (scheduled at 2021-11-08 14:32:47.787050+00:00) securityworker stdout | 2021-11-08 14:32:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 14:32:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 14:32:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:32:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 14:32:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:32:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 14:32:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 14:32:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:32:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:32:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:32:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:32:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:32:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:32:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 14:32:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:32:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 14:32:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 14:32:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:32:47,852 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:32:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 14:32:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:32:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 14:32:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 14:32:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 14:32:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:32:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:32:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:32:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:32:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 14:32:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:32:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:32:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 14:32:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 14:32:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 14:32:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 353-393 securityworker stdout | 2021-11-08 14:32:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 14:32:47,889 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:32:47,897 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:32:50,325 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:00 UTC)" (scheduled at 2021-11-08 14:32:50.322052+00:00) notificationworker stdout | 2021-11-08 14:32:50,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:32:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:50 UTC)" (scheduled at 2021-11-08 14:32:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:32:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:32:50,833 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:32:50,834 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:32:50,835 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:32:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:21 UTC)" (scheduled at 2021-11-08 14:32:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:32:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:32:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:37:52 UTC)" (scheduled at 2021-11-08 14:32:52.376404+00:00) notificationworker stdout | 2021-11-08 14:32:52,393 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:37:52 UTC)" executed successfully gcworker stdout | 2021-11-08 14:32:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:22 UTC)" (scheduled at 2021-11-08 14:32:52.617060+00:00) gcworker stdout | 2021-11-08 14:32:52,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:32:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:54 UTC)" (scheduled at 2021-11-08 14:32:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:32:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:32:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:55 UTC)" (scheduled at 2021-11-08 14:32:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:32:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:33:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:33:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:10 UTC)" (scheduled at 2021-11-08 14:33:00.322052+00:00) notificationworker stdout | 2021-11-08 14:33:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:33:02 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.161 405 0.161) gunicorn-web stdout | 2021-11-08 14:33:02,041 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:33:02 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-registry stdout | 2021-11-08 14:33:05,136 [241] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:33:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:33:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.462 325 0.462) exportactionlogsworker stdout | 2021-11-08 14:33:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:06 UTC)" (scheduled at 2021-11-08 14:33:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:33:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:33:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:09 UTC)" (scheduled at 2021-11-08 14:33:09.376681+00:00) notificationworker stdout | 2021-11-08 14:33:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:33:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:20 UTC)" (scheduled at 2021-11-08 14:33:10.322052+00:00) notificationworker stdout | 2021-11-08 14:33:10,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:33:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:38:14 UTC)" (scheduled at 2021-11-08 14:33:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:33:15,097 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:38:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:33:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:16 UTC)" (scheduled at 2021-11-08 14:33:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:33:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:33:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:47 UTC)" (scheduled at 2021-11-08 14:33:17.787050+00:00) securityworker stdout | 2021-11-08 14:33:18,809 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 362-402 securityworker stdout | 2021-11-08 14:33:18,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 14:33:18,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:33:18,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 14:33:18,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 14:33:18,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 14:33:18,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 14:33:18,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 14:33:18,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 14:33:18,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 14:33:18,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 14:33:18,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 14:33:18,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:33:19,177 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 445-464 securityworker stdout | 2021-11-08 14:33:19,180 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 23-63 securityworker stdout | 2021-11-08 14:33:19,182 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:33:19,184 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 14:33:19,184 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:33:19,187 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:33:19,190 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:33:19,193 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 14:33:19,195 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:33:19,197 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:33:19,199 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 14:33:19,213 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:33:19,216 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:33:19,219 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 14:33:19,222 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 14:33:19,225 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 19-59 securityworker stdout | 2021-11-08 14:33:19,227 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:33:19,230 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:33:19,232 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 14:33:19,234 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 14:33:19,237 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:33:19,239 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:33:19,241 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:33:19,241 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:33:19,313 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:33:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:30 UTC)" (scheduled at 2021-11-08 14:33:20.322052+00:00) notificationworker stdout | 2021-11-08 14:33:20,699 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:33:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:51 UTC)" (scheduled at 2021-11-08 14:33:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:33:21,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:33:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:52 UTC)" (scheduled at 2021-11-08 14:33:22.617060+00:00) gcworker stdout | 2021-11-08 14:33:22,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:33:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:27 UTC)" (scheduled at 2021-11-08 14:33:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:33:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:33:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:40 UTC)" (scheduled at 2021-11-08 14:33:30.322052+00:00) notificationworker stdout | 2021-11-08 14:33:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:33:31,684 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:33:31,684 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:33:31,685 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:33:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:33:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:50 UTC)" (scheduled at 2021-11-08 14:33:40.322052+00:00) notificationworker stdout | 2021-11-08 14:33:41,541 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:33:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:33:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:17 UTC)" (scheduled at 2021-11-08 14:33:47.787050+00:00) securityworker stdout | 2021-11-08 14:33:48,041 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:33:48,044 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 14:33:48,047 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:33:48,049 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 14:33:48,052 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 217-257 securityworker stdout | 2021-11-08 14:33:48,055 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 257-297 securityworker stdout | 2021-11-08 14:33:48,057 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 14:33:48,059 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 14:33:48,062 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 32-72 securityworker stdout | 2021-11-08 14:33:48,065 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:33:48,067 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:33:48,069 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 14:33:48,071 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 14:33:48,073 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 14:33:48,075 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 14:33:48,077 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:33:48,079 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 14:33:48,079 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:33:48,082 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 14:33:48,084 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 37-77 securityworker stdout | 2021-11-08 14:33:48,086 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:33:48,088 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:33:48,091 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 77-117 securityworker stdout | 2021-11-08 14:33:48,093 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:33:48,095 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 14:33:48,098 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 277-317 securityworker stdout | 2021-11-08 14:33:48,100 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 14:33:48,103 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 14:33:48,106 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 199-239 securityworker stdout | 2021-11-08 14:33:48,109 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:33:48,110 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 14:33:48,113 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 444-464 securityworker stdout | 2021-11-08 14:33:48,116 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 379-419 securityworker stdout | 2021-11-08 14:33:48,116 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:33:48,721 [102] [INFO] [util.migrate.allocator] Found 11 candidates, processing block notificationworker stdout | 2021-11-08 14:33:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:00 UTC)" (scheduled at 2021-11-08 14:33:50.322052+00:00) notificationworker stdout | 2021-11-08 14:33:50,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:33:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:50 UTC)" (scheduled at 2021-11-08 14:33:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:33:50,412 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:33:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:21 UTC)" (scheduled at 2021-11-08 14:33:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:33:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:33:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:22 UTC)" (scheduled at 2021-11-08 14:33:52.617060+00:00) gcworker stdout | 2021-11-08 14:33:52,687 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:33:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:54 UTC)" (scheduled at 2021-11-08 14:33:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:33:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:33:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:55 UTC)" (scheduled at 2021-11-08 14:33:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:33:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:34:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:34:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:10 UTC)" (scheduled at 2021-11-08 14:34:00.322052+00:00) notificationworker stdout | 2021-11-08 14:34:01,586 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:34:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:06 UTC)" (scheduled at 2021-11-08 14:34:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:34:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:34:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:09 UTC)" (scheduled at 2021-11-08 14:34:09.376681+00:00) notificationworker stdout | 2021-11-08 14:34:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:34:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:20 UTC)" (scheduled at 2021-11-08 14:34:10.322052+00:00) notificationworker stdout | 2021-11-08 14:34:10,356 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:34:13 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 14:34:13,612 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:34:13 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:34:14,794 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:34:14,794 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:34:14,795 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:17 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:34:14 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.024 1690 0.024) gunicorn-registry stdout | 2021-11-08 14:34:14,819 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:34:14 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 14:34:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:16 UTC)" (scheduled at 2021-11-08 14:34:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:34:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:34:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:47 UTC)" (scheduled at 2021-11-08 14:34:17.787050+00:00) securityworker stdout | 2021-11-08 14:34:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:34:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 14:34:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:34:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 14:34:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:34:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:34:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 14:34:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 14:34:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 14:34:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:34:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 14:34:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:34:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:34:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 14:34:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:34:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 14:34:17,884 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:34:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 14:34:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:34:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 14:34:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 14:34:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 36-76 securityworker stdout | 2021-11-08 14:34:17,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 14:34:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 14:34:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 14:34:17,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:34:17,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:34:17,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 264-304 securityworker stdout | 2021-11-08 14:34:17,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:34:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 14:34:17,916 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 14:34:17,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:34:17,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 14:34:17,923 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 14:34:17,923 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:34:18,194 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 14:34:20,222 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:34:20,223 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:34:20,224 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:34:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:30 UTC)" (scheduled at 2021-11-08 14:34:20.322052+00:00) notificationworker stdout | 2021-11-08 14:34:20,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:34:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:51 UTC)" (scheduled at 2021-11-08 14:34:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:34:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:34:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:52 UTC)" (scheduled at 2021-11-08 14:34:22.617060+00:00) gcworker stdout | 2021-11-08 14:34:22,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:34:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:34:25 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.052 468 0.051) gunicorn-web stdout | 2021-11-08 14:34:25,568 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:34:25 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:34:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:27 UTC)" (scheduled at 2021-11-08 14:34:27.884604+00:00) gunicorn-registry stdout | 2021-11-08 14:34:28,038 [235] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:34:28 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:34:28 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.087 325 0.087) namespacegcworker stdout | 2021-11-08 14:34:28,158 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:34:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:40 UTC)" (scheduled at 2021-11-08 14:34:30.322052+00:00) notificationworker stdout | 2021-11-08 14:34:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:34:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:50 UTC)" (scheduled at 2021-11-08 14:34:40.322052+00:00) notificationworker stdout | 2021-11-08 14:34:40,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:34:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:34:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:17 UTC)" (scheduled at 2021-11-08 14:34:47.787050+00:00) securityworker stdout | 2021-11-08 14:34:48,116 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:34:48,120 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 14:34:48,122 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:34:48,126 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 219-259 securityworker stdout | 2021-11-08 14:34:48,128 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 14:34:48,131 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 14:34:48,135 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 14:34:48,138 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 14:34:48,141 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 14:34:48,144 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 14:34:48,147 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:34:48,149 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 14:34:48,216 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 429-464 securityworker stdout | 2021-11-08 14:34:48,220 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 14:34:48,220 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:34:48,224 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:34:48,226 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 14:34:48,229 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:34:48,232 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 14:34:48,235 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 14:34:48,238 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:34:48,240 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 14:34:48,243 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 14:34:48,246 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 14:34:48,249 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 381-421 securityworker stdout | 2021-11-08 14:34:48,252 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 93-133 securityworker stdout | 2021-11-08 14:34:48,255 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:34:48,258 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:34:48,261 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:34:48,264 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 14:34:48,268 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 14:34:48,272 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 14:34:48,272 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:34:48,460 [102] [INFO] [util.migrate.allocator] Found 23 candidates, processing block notificationworker stdout | 2021-11-08 14:34:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:00 UTC)" (scheduled at 2021-11-08 14:34:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:34:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:50 UTC)" (scheduled at 2021-11-08 14:34:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:34:50,587 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:34:50,749 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:34:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:21 UTC)" (scheduled at 2021-11-08 14:34:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:34:51,815 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:34:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:22 UTC)" (scheduled at 2021-11-08 14:34:52.617060+00:00) gcworker stdout | 2021-11-08 14:34:52,642 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:34:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:54 UTC)" (scheduled at 2021-11-08 14:34:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:34:54,188 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:34:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:55 UTC)" (scheduled at 2021-11-08 14:34:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:34:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:35:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:34:58,413 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:34:58,413 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:34:58,413 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:17 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:35:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:35:00,280 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:35:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:35:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:10 UTC)" (scheduled at 2021-11-08 14:35:00.322052+00:00) notificationworker stdout | 2021-11-08 14:35:00,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:35:00 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.023 1690 0.022) gunicorn-registry stdout | 2021-11-08 14:35:00,510 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:35:00 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 14:35:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:06 UTC)" (scheduled at 2021-11-08 14:35:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:35:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:35:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:09 UTC)" (scheduled at 2021-11-08 14:35:09.376681+00:00) notificationworker stdout | 2021-11-08 14:35:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:35:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:20 UTC)" (scheduled at 2021-11-08 14:35:10.322052+00:00) notificationworker stdout | 2021-11-08 14:35:10,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:35:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:16 UTC)" (scheduled at 2021-11-08 14:35:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:35:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:35:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:47 UTC)" (scheduled at 2021-11-08 14:35:17.787050+00:00) securityworker stdout | 2021-11-08 14:35:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 14:35:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 14:35:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:35:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 14:35:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 300-340 securityworker stdout | 2021-11-08 14:35:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 14:35:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 148-188 securityworker stdout | 2021-11-08 14:35:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 14:35:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 340-380 securityworker stdout | 2021-11-08 14:35:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 14:35:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 14:35:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:35:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 14:35:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 14:35:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:35:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 14:35:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:35:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 426-464 securityworker stdout | 2021-11-08 14:35:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:35:17,850 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:35:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 14:35:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:35:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 14:35:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 14:35:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 14:35:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 14:35:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:35:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:35:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:35:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 14:35:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:35:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:35:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 14:35:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:35:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 14:35:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:35:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 460-464 securityworker stdout | 2021-11-08 14:35:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:35:17,894 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:35:17,904 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:35:17 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.414 325 0.413) gunicorn-registry stdout | 2021-11-08 14:35:17,939 [233] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:35:17 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:35:19,774 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:35:19,774 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:35:19,776 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:35:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:30 UTC)" (scheduled at 2021-11-08 14:35:20.322052+00:00) notificationworker stdout | 2021-11-08 14:35:20,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:35:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:51 UTC)" (scheduled at 2021-11-08 14:35:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:35:21,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:35:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:52 UTC)" (scheduled at 2021-11-08 14:35:22.617060+00:00) gcworker stdout | 2021-11-08 14:35:22,631 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:35:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:35:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:27 UTC)" (scheduled at 2021-11-08 14:35:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:35:27,898 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:35:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:40 UTC)" (scheduled at 2021-11-08 14:35:30.322052+00:00) notificationworker stdout | 2021-11-08 14:35:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:35:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:50 UTC)" (scheduled at 2021-11-08 14:35:40.322052+00:00) notificationworker stdout | 2021-11-08 14:35:40,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:35:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:35:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:35:42,520 [234] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:35:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:35:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.028 1690 0.024) gunicorn-registry stdout | 2021-11-08 14:35:42,674 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:35:42 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:35:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:17 UTC)" (scheduled at 2021-11-08 14:35:47.787050+00:00) securityworker stdout | 2021-11-08 14:35:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 14:35:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 21-61 securityworker stdout | 2021-11-08 14:35:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 14:35:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:35:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 14:35:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 14:35:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 14:35:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:35:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 14:35:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:35:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:35:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 14:35:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 320-360 securityworker stdout | 2021-11-08 14:35:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 14:35:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 14:35:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 14:35:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 14:35:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 14:35:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 14:35:47,855 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:35:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 14:35:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:35:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:35:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 14:35:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 14:35:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 199-239 securityworker stdout | 2021-11-08 14:35:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:35:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:35:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 14:35:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 14:35:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 14:35:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:35:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 14:35:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:35:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:35:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 14:35:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:35:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 434-464 securityworker stdout | 2021-11-08 14:35:47,891 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:35:47,900 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 14:35:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:40:49 UTC)" (scheduled at 2021-11-08 14:35:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 14:35:49,462 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:40:49 UTC)" executed successfully securityworker stdout | 2021-11-08 14:35:49,898 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:35:49,899 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:35:49,899 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:35:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:00 UTC)" (scheduled at 2021-11-08 14:35:50.322052+00:00) notificationworker stdout | 2021-11-08 14:35:50,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:35:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:50 UTC)" (scheduled at 2021-11-08 14:35:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:35:50,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:35:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:21 UTC)" (scheduled at 2021-11-08 14:35:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:35:51,805 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:35:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:22 UTC)" (scheduled at 2021-11-08 14:35:52.617060+00:00) gcworker stdout | 2021-11-08 14:35:52,636 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:35:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:54 UTC)" (scheduled at 2021-11-08 14:35:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:35:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:35:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:55 UTC)" (scheduled at 2021-11-08 14:35:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:35:55,133 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:36:55 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:35:56,353 [244] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:35:56 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) gunicorn-registry stdout | 2021-11-08 14:35:56,355 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:35:56 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:36:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:10 UTC)" (scheduled at 2021-11-08 14:36:00.322052+00:00) notificationworker stdout | 2021-11-08 14:36:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:36:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:06 UTC)" (scheduled at 2021-11-08 14:36:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:36:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:36:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:09 UTC)" (scheduled at 2021-11-08 14:36:09.376681+00:00) notificationworker stdout | 2021-11-08 14:36:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:36:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:20 UTC)" (scheduled at 2021-11-08 14:36:10.322052+00:00) notificationworker stdout | 2021-11-08 14:36:10,443 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:36:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:16 UTC)" (scheduled at 2021-11-08 14:36:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:36:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:36:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:47 UTC)" (scheduled at 2021-11-08 14:36:17.787050+00:00) securityworker stdout | 2021-11-08 14:36:18,194 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 39-79 securityworker stdout | 2021-11-08 14:36:18,197 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:36:18,199 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:36:18,202 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 14:36:18,205 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 14:36:18,207 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 14:36:18,209 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 14:36:18,211 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:36:18,213 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 14:36:18,215 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:36:18,218 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:36:18,220 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 14:36:18,222 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:36:18,224 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 14:36:18,226 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 securityworker stdout | 2021-11-08 14:36:18,228 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 14:36:18,230 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 14:36:18,230 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:36:18,233 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 14:36:18,235 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 14:36:18,236 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 39-79 securityworker stdout | 2021-11-08 14:36:18,238 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 14:36:18,241 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 14:36:18,243 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 14:36:18,246 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 263-303 securityworker stdout | 2021-11-08 14:36:18,248 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:36:18,251 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:36:18,254 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 260-300 securityworker stdout | 2021-11-08 14:36:18,259 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 14:36:18,261 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 14:36:18,264 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 14:36:18,266 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 14:36:18,268 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 14:36:18,270 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 14:36:18,272 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 14:36:18,272 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:36:18,479 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:36:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:30 UTC)" (scheduled at 2021-11-08 14:36:20.322052+00:00) notificationworker stdout | 2021-11-08 14:36:20,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:36:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:51 UTC)" (scheduled at 2021-11-08 14:36:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:36:21,817 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:36:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:52 UTC)" (scheduled at 2021-11-08 14:36:22.617060+00:00) gcworker stdout | 2021-11-08 14:36:22,639 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:52 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:36:27,396 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:36:27 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:36:27 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.683 325 0.683) namespacegcworker stdout | 2021-11-08 14:36:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:27 UTC)" (scheduled at 2021-11-08 14:36:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:36:27,919 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:36:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:40 UTC)" (scheduled at 2021-11-08 14:36:30.322052+00:00) notificationworker stdout | 2021-11-08 14:36:30,352 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:36:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:50 UTC)" (scheduled at 2021-11-08 14:36:40.322052+00:00) notificationworker stdout | 2021-11-08 14:36:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:36:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:36:43 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 14:36:43,391 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:36:43 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:36:43,392 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:36:43,392 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:36:43,393 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:36:47 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:36:43 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.087 1690 0.087) gunicorn-registry stdout | 2021-11-08 14:36:43,851 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:36:43 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:36:47,613 [236] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:36:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:36:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.085 325 0.085) securityworker stdout | 2021-11-08 14:36:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:17 UTC)" (scheduled at 2021-11-08 14:36:47.787050+00:00) securityworker stdout | 2021-11-08 14:36:47,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 257-297 securityworker stdout | 2021-11-08 14:36:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 14:36:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 14:36:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:36:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 14:36:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:36:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:36:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 193-233 securityworker stdout | 2021-11-08 14:36:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:36:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 14:36:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 14:36:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:36:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 14:36:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 14:36:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 14:36:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 14:36:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 14:36:47,846 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:36:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:36:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:36:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 14:36:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 372-412 securityworker stdout | 2021-11-08 14:36:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 263-303 securityworker stdout | 2021-11-08 14:36:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:36:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 14:36:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 14:36:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 14:36:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 14:36:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 14:36:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 27-67 securityworker stdout | 2021-11-08 14:36:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:36:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 14:36:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 14:36:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:36:47,886 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:36:47,891 [102] [INFO] [util.migrate.allocator] Found 14 candidates, processing block notificationworker stdout | 2021-11-08 14:36:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:00 UTC)" (scheduled at 2021-11-08 14:36:50.322052+00:00) notificationworker stdout | 2021-11-08 14:36:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:36:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:50 UTC)" (scheduled at 2021-11-08 14:36:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:36:50,411 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:36:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:21 UTC)" (scheduled at 2021-11-08 14:36:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:36:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:36:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:22 UTC)" (scheduled at 2021-11-08 14:36:52.617060+00:00) gcworker stdout | 2021-11-08 14:36:52,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:22 UTC)" executed successfully securityworker stdout | 2021-11-08 14:36:53,239 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:36:53,239 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:36:53,240 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:36:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:54 UTC)" (scheduled at 2021-11-08 14:36:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:36:54,186 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:36:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:55 UTC)" (scheduled at 2021-11-08 14:36:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:36:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:37:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:36:59 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:36:59,495 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:36:59 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:36:59 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.022 1690 0.022) gunicorn-registry stdout | 2021-11-08 14:36:59,669 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:36:59 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:37:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:10 UTC)" (scheduled at 2021-11-08 14:37:00.322052+00:00) notificationworker stdout | 2021-11-08 14:37:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:37:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:06 UTC)" (scheduled at 2021-11-08 14:37:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:37:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:37:08 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:37:08,277 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:37:08 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:37:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:09 UTC)" (scheduled at 2021-11-08 14:37:09.376681+00:00) notificationworker stdout | 2021-11-08 14:37:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:37:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:20 UTC)" (scheduled at 2021-11-08 14:37:10.322052+00:00) notificationworker stdout | 2021-11-08 14:37:10,489 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:37:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:16 UTC)" (scheduled at 2021-11-08 14:37:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:37:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:37:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:47 UTC)" (scheduled at 2021-11-08 14:37:17.787050+00:00) securityworker stdout | 2021-11-08 14:37:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 14:37:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 14:37:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:37:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 14:37:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:37:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 14:37:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 14:37:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 14:37:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 14:37:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:37:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 14:37:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:37:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:37:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:37:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 14:37:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:37:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 14:37:17,860 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:37:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:37:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 14:37:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 14:37:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 14:37:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 14:37:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:37:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:37:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 14:37:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:37:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 14:37:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:37:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 14:37:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 14:37:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 14:37:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:37:17,890 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:37:17,897 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:37:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:30 UTC)" (scheduled at 2021-11-08 14:37:20.322052+00:00) notificationworker stdout | 2021-11-08 14:37:20,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:37:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:51 UTC)" (scheduled at 2021-11-08 14:37:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:37:21,822 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:51 UTC)" executed successfully securityworker stdout | 2021-11-08 14:37:22,333 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:37:22,333 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:37:22,334 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:47 UTC)" executed successfully gcworker stdout | 2021-11-08 14:37:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:52 UTC)" (scheduled at 2021-11-08 14:37:22.617060+00:00) gcworker stdout | 2021-11-08 14:37:22,652 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:37:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:37:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:27 UTC)" (scheduled at 2021-11-08 14:37:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:37:27,909 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:27 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:37:28,524 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:37:28 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:37:28 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.039 47 0.039) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:37:28 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.043 877 0.043) gunicorn-web stdout | 2021-11-08 14:37:28,528 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:37:28 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:37:28,543 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:37:28 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:37:28 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.059 62 0.059) notificationworker stdout | 2021-11-08 14:37:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:40 UTC)" (scheduled at 2021-11-08 14:37:30.322052+00:00) notificationworker stdout | 2021-11-08 14:37:30,347 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:37:37 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1690 0.019) gunicorn-registry stdout | 2021-11-08 14:37:37,396 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:37:37 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:37:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:50 UTC)" (scheduled at 2021-11-08 14:37:40.322052+00:00) notificationworker stdout | 2021-11-08 14:37:40,346 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:37:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:37:41 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1690 0.014) gunicorn-registry stdout | 2021-11-08 14:37:41,893 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:37:41 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:37:46,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:42:46 UTC)" (scheduled at 2021-11-08 14:37:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:37:46,152 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:42:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:37:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:17 UTC)" (scheduled at 2021-11-08 14:37:47.787050+00:00) securityworker stdout | 2021-11-08 14:37:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 14:37:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 14:37:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 14:37:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 14:37:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:37:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:37:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 14:37:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 14:37:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:37:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:37:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 14:37:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:37:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:37:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:37:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 14:37:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 14:37:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 14:37:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 14:37:47,849 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:37:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:37:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 436-464 securityworker stdout | 2021-11-08 14:37:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:37:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 14:37:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 14:37:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 289-329 securityworker stdout | 2021-11-08 14:37:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 14:37:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 14:37:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 14:37:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 14:37:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 14:37:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 14:37:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 14:37:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:37:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 14:37:47,880 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:37:47,887 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block gunicorn-registry stdout | 2021-11-08 14:37:50,166 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:37:50 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:37:50 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1692 0.019) notificationworker stdout | 2021-11-08 14:37:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:00 UTC)" (scheduled at 2021-11-08 14:37:50.322052+00:00) notificationworker stdout | 2021-11-08 14:37:50,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:37:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:50 UTC)" (scheduled at 2021-11-08 14:37:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:37:50,424 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:37:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:21 UTC)" (scheduled at 2021-11-08 14:37:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:37:51,822 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:37:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:42:52 UTC)" (scheduled at 2021-11-08 14:37:52.376404+00:00) notificationworker stdout | 2021-11-08 14:37:52,409 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:42:52 UTC)" executed successfully gcworker stdout | 2021-11-08 14:37:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:22 UTC)" (scheduled at 2021-11-08 14:37:52.617060+00:00) gcworker stdout | 2021-11-08 14:37:52,649 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:37:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:54 UTC)" (scheduled at 2021-11-08 14:37:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:37:54,197 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:37:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:55 UTC)" (scheduled at 2021-11-08 14:37:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:37:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:38:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:38:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:10 UTC)" (scheduled at 2021-11-08 14:38:00.322052+00:00) notificationworker stdout | 2021-11-08 14:38:00,343 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:38:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:06 UTC)" (scheduled at 2021-11-08 14:38:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:38:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:38:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:09 UTC)" (scheduled at 2021-11-08 14:38:09.376681+00:00) notificationworker stdout | 2021-11-08 14:38:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:38:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:20 UTC)" (scheduled at 2021-11-08 14:38:10.322052+00:00) notificationworker stdout | 2021-11-08 14:38:10,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:20 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:38:13,574 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:38:13 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:38:13 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) repositorygcworker stdout | 2021-11-08 14:38:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:43:14 UTC)" (scheduled at 2021-11-08 14:38:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:38:14,934 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:43:14 UTC)" executed successfully securityworker stdout | 2021-11-08 14:38:15,273 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:38:15,273 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:38:15,274 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:38:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:16 UTC)" (scheduled at 2021-11-08 14:38:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:38:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:38:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:47 UTC)" (scheduled at 2021-11-08 14:38:17.787050+00:00) securityworker stdout | 2021-11-08 14:38:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:38:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 14:38:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 14:38:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 14:38:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:38:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 14:38:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:38:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 14:38:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:38:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 14:38:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:38:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:38:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 14:38:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:38:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 14:38:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:38:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:38:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:38:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:38:17,865 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:38:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 14:38:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 14:38:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 14:38:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 14:38:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:38:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 14:38:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:38:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 237-277 securityworker stdout | 2021-11-08 14:38:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:38:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 14:38:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 14:38:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 14:38:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 429-464 securityworker stdout | 2021-11-08 14:38:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 14:38:17,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:38:17,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:38:17,902 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:38:17,909 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 14:38:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:30 UTC)" (scheduled at 2021-11-08 14:38:20.322052+00:00) notificationworker stdout | 2021-11-08 14:38:20,351 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:38:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:51 UTC)" (scheduled at 2021-11-08 14:38:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:38:21,820 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:38:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:52 UTC)" (scheduled at 2021-11-08 14:38:22.617060+00:00) gcworker stdout | 2021-11-08 14:38:22,639 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:38:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:27 UTC)" (scheduled at 2021-11-08 14:38:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:38:27,902 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:27 UTC)" executed successfully securityworker stdout | 2021-11-08 14:38:28,798 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:38:28,798 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:38:28,799 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:38:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:38:30,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:40 UTC)" (scheduled at 2021-11-08 14:38:30.322052+00:00) notificationworker stdout | 2021-11-08 14:38:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:38:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:50 UTC)" (scheduled at 2021-11-08 14:38:40.322052+00:00) notificationworker stdout | 2021-11-08 14:38:40,352 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:38:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:38:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:17 UTC)" (scheduled at 2021-11-08 14:38:47.787050+00:00) securityworker stdout | 2021-11-08 14:38:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:38:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 14:38:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:38:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 21-61 securityworker stdout | 2021-11-08 14:38:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 14:38:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 14:38:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:38:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 14:38:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:38:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 14:38:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 14:38:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 445-464 securityworker stdout | 2021-11-08 14:38:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:38:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 14:38:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 14:38:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 14:38:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:38:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 14:38:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:38:47,879 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:38:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 263-303 securityworker stdout | 2021-11-08 14:38:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:38:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 14:38:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:38:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 14:38:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 14:38:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 215-255 securityworker stdout | 2021-11-08 14:38:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 161-201 securityworker stdout | 2021-11-08 14:38:47,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:38:47,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 14:38:47,914 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:38:47,916 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:38:47,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:38:47,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:38:47,923 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:38:47,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:38:47,928 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:38:47,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:38:47,931 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:38:47,939 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:38:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:00 UTC)" (scheduled at 2021-11-08 14:38:50.322052+00:00) notificationworker stdout | 2021-11-08 14:38:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:38:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:50 UTC)" (scheduled at 2021-11-08 14:38:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:38:50,412 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:38:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:21 UTC)" (scheduled at 2021-11-08 14:38:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:38:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:38:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:22 UTC)" (scheduled at 2021-11-08 14:38:52.617060+00:00) gcworker stdout | 2021-11-08 14:38:52,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:38:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:54 UTC)" (scheduled at 2021-11-08 14:38:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:38:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:54 UTC)" executed successfully securityworker stdout | 2021-11-08 14:38:54,508 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:38:54,508 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:38:54,509 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:17 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:38:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:55 UTC)" (scheduled at 2021-11-08 14:38:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:38:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:39:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:39:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:10 UTC)" (scheduled at 2021-11-08 14:39:00.322052+00:00) notificationworker stdout | 2021-11-08 14:39:00,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:39:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:06 UTC)" (scheduled at 2021-11-08 14:39:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:39:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:39:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:09 UTC)" (scheduled at 2021-11-08 14:39:09.376681+00:00) notificationworker stdout | 2021-11-08 14:39:09,378 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:39:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:20 UTC)" (scheduled at 2021-11-08 14:39:10.322052+00:00) notificationworker stdout | 2021-11-08 14:39:10,395 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:39:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:16 UTC)" (scheduled at 2021-11-08 14:39:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:39:16,907 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:39:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:47 UTC)" (scheduled at 2021-11-08 14:39:17.787050+00:00) securityworker stdout | 2021-11-08 14:39:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 264-304 securityworker stdout | 2021-11-08 14:39:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 186-226 securityworker stdout | 2021-11-08 14:39:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 14:39:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 14:39:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:39:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:39:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 14:39:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:39:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 14:39:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:39:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 14:39:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 379-419 securityworker stdout | 2021-11-08 14:39:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:39:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 14:39:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:39:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 14:39:17,854 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:39:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 14:39:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:39:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 14:39:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 14:39:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:39:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 14:39:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:39:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 14:39:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 14:39:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:39:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 14:39:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 14:39:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:39:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:39:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:39:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 14:39:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 14:39:17,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 14:39:17,897 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:39:17,907 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 14:39:20,119 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:39:20,120 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:39:20,120 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:39:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:30 UTC)" (scheduled at 2021-11-08 14:39:20.322052+00:00) notificationworker stdout | 2021-11-08 14:39:20,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:39:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:51 UTC)" (scheduled at 2021-11-08 14:39:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:39:21,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:39:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:52 UTC)" (scheduled at 2021-11-08 14:39:22.617060+00:00) gcworker stdout | 2021-11-08 14:39:22,631 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:39:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:26 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:39:26,608 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:26 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:39:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:27 UTC)" (scheduled at 2021-11-08 14:39:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:39:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:39:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:40 UTC)" (scheduled at 2021-11-08 14:39:30.322052+00:00) notificationworker stdout | 2021-11-08 14:39:30,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.005 228 0.005) gunicorn-registry stdout | 2021-11-08 14:39:35,011 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:39:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:50 UTC)" (scheduled at 2021-11-08 14:39:40.322052+00:00) notificationworker stdout | 2021-11-08 14:39:40,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:39:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:42 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.040 407 0.040) gunicorn-web stdout | 2021-11-08 14:39:42,301 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:42 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:39:46,753 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:46 +0000] "GET /repository/finacle10225/finaclecrm?tab=tags HTTP/1.0" 200 81214 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:46 +0000] "GET /repository/finacle10225/finaclecrm?tab=tags HTTP/2.0" 200 12916 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.008 558 0.007) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/user/ HTTP/2.0" 200 1442 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.034 375 0.034) gunicorn-web stdout | 2021-11-08 14:39:47,659 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/user/ HTTP/1.0" 200 1442 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/messages HTTP/2.0" 200 17 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.022 32 0.022) gunicorn-web stdout | 2021-11-08 14:39:47,686 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:39:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:17 UTC)" (scheduled at 2021-11-08 14:39:47.787050+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.022 47 0.022) gunicorn-web stdout | 2021-11-08 14:39:47,809 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:39:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:39:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:39:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:39:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 52-92 securityworker stdout | 2021-11-08 14:39:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 14:39:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 14:39:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:39:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 gunicorn-web stdout | 2021-11-08 14:39:47,883 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.099 39 0.099) securityworker stdout | 2021-11-08 14:39:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 gunicorn-web stdout | 2021-11-08 14:39:47,885 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.143 425 0.143) securityworker stdout | 2021-11-08 14:39:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 14:39:47,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 gunicorn-web stdout | 2021-11-08 14:39:47,888 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/repository/finacle10225/finaclecrm?includeStats=true&includeTags=false HTTP/1.0" 200 3635 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:47 +0000] "GET /api/v1/repository/finacle10225/finaclecrm?includeStats=true&includeTags=false HTTP/2.0" 200 3635 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.144 76 0.144) securityworker stdout | 2021-11-08 14:39:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:39:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 14:39:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:39:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 14:39:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 14:39:47,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:39:47,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 14:39:47,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:39:47,910 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:39:47,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:39:47,916 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:39:47,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:39:47,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 298-338 securityworker stdout | 2021-11-08 14:39:47,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 14:39:47,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 14:39:47,927 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:39:47,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 14:39:47,932 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 14:39:47,935 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 14:39:47,937 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 14:39:47,939 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 77-117 securityworker stdout | 2021-11-08 14:39:47,941 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 14:39:47,943 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 14:39:47,945 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 14:39:47,948 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:39:47,951 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:39:47,951 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:39:47,961 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block gunicorn-web stdout | 2021-11-08 14:39:48,660 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:48 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:bcb4a3e6e27c441ccb318e96569343890341fb7289f38b9b93537b798489e006/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:48 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:bcb4a3e6e27c441ccb318e96569343890341fb7289f38b9b93537b798489e006/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.057 130 0.057) gunicorn-web stdout | 2021-11-08 14:39:48,837 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:48 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:48 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.145 62 0.146) notificationworker stdout | 2021-11-08 14:39:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:00 UTC)" (scheduled at 2021-11-08 14:39:50.322052+00:00) notificationworker stdout | 2021-11-08 14:39:50,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:39:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:50 UTC)" (scheduled at 2021-11-08 14:39:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:39:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:39:50,489 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:39:50,489 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:39:50,490 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:39:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:21 UTC)" (scheduled at 2021-11-08 14:39:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:39:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:39:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:22 UTC)" (scheduled at 2021-11-08 14:39:52.617060+00:00) gcworker stdout | 2021-11-08 14:39:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:22 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:39:53,557 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:53 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:aac68378af914022798fffa1d9fa66866647f0160cc8cf8ee62d13b10e510358/security?vulnerabilities=true HTTP/1.0" 200 944287 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:53 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:aac68378af914022798fffa1d9fa66866647f0160cc8cf8ee62d13b10e510358/security?vulnerabilities=true HTTP/2.0" 200 944287 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (5.048 128 4.953) repositorygcworker stdout | 2021-11-08 14:39:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:54 UTC)" (scheduled at 2021-11-08 14:39:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:39:54,189 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:54 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:39:54,345 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:8eb18624aa86ddabecefe4e882c45bad241dcac6d32b5379defb649ec9f239d2/security?vulnerabilities=true HTTP/1.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:39:54,346 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:cbccbf418c361d7484e9277dcb0839e75c5603159574d3e1f07020de2bb9a6b7/security?vulnerabilities=true HTTP/1.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:8eb18624aa86ddabecefe4e882c45bad241dcac6d32b5379defb649ec9f239d2/security?vulnerabilities=true HTTP/2.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (5.981 129 5.741) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository/finacle10225/finaclecrm/manifest/sha256:cbccbf418c361d7484e9277dcb0839e75c5603159574d3e1f07020de2bb9a6b7/security?vulnerabilities=true HTTP/2.0" 200 950084 "https://enterprisequay.rblbank.com/repository/finacle10225/finaclecrm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (5.995 129 5.743) gunicorn-web stdout | 2021-11-08 14:39:54,859 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.026 448 0.026) gunicorn-web stdout | 2021-11-08 14:39:54,873 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:39:54,873 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:39:54,873 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.032 91 0.032) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.040 496 0.040) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.040 89 0.040) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.044 92 0.044) gunicorn-web stdout | 2021-11-08 14:39:54,886 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:39:54 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:39:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:55 UTC)" (scheduled at 2021-11-08 14:39:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:39:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:40:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:40:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:10 UTC)" (scheduled at 2021-11-08 14:40:00.322052+00:00) notificationworker stdout | 2021-11-08 14:40:00,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:01 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm?includeStats=true&includeTags=false HTTP/2.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.044 77 0.043) gunicorn-web stdout | 2021-11-08 14:40:01,133 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:01 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm?includeStats=true&includeTags=false HTTP/1.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:01 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.049 133 0.048) gunicorn-web stdout | 2021-11-08 14:40:01,137 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:01 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:01 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.054 408 0.054) gunicorn-web stdout | 2021-11-08 14:40:01,761 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:01 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:40:06,300 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:06 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:ff6563f0c17435ee75f82581f2aeb0a859586ee2e7f9c4e3d886bedf68bf4290/security?vulnerabilities=true HTTP/1.0" 200 941082 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:06 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:ff6563f0c17435ee75f82581f2aeb0a859586ee2e7f9c4e3d886bedf68bf4290/security?vulnerabilities=true HTTP/2.0" 200 941082 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (2.486 187 2.386) exportactionlogsworker stdout | 2021-11-08 14:40:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:06 UTC)" (scheduled at 2021-11-08 14:40:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:40:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:06 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:40:06,463 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:06 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2/security?vulnerabilities=true HTTP/1.0" 200 946879 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:06 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2/security?vulnerabilities=true HTTP/2.0" 200 946879 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (2.645 129 2.547) gunicorn-web stdout | 2021-11-08 14:40:06,965 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:06 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:863e09b600030be272b99e063c9bd85b5b5bf3d3b4d4c845e98de055319ac39d/security?vulnerabilities=true HTTP/1.0" 200 946879 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:07 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:863e09b600030be272b99e063c9bd85b5b5bf3d3b4d4c845e98de055319ac39d/security?vulnerabilities=true HTTP/2.0" 200 946879 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (3.118 130 3.049) gunicorn-registry stdout | 2021-11-08 14:40:07,287 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:07 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:07 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-web stdout | 2021-11-08 14:40:08,259 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:08 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:0af14d73008fda0f2f7601453ccf022a3317316051d6023ea679853b77e20b98/security?vulnerabilities=true HTTP/1.0" 200 941082 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:08 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:0af14d73008fda0f2f7601453ccf022a3317316051d6023ea679853b77e20b98/security?vulnerabilities=true HTTP/2.0" 200 941082 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (4.427 129 4.346) notificationworker stdout | 2021-11-08 14:40:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:09 UTC)" (scheduled at 2021-11-08 14:40:09.376681+00:00) notificationworker stdout | 2021-11-08 14:40:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:40:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:20 UTC)" (scheduled at 2021-11-08 14:40:10.322052+00:00) notificationworker stdout | 2021-11-08 14:40:10,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:15 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm?includeTags=false HTTP/2.0" 200 348 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2?tab=vulnerabilities" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.069 65 0.069) gunicorn-web stdout | 2021-11-08 14:40:15,430 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:15 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm?includeTags=false HTTP/1.0" 200 348 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2?tab=vulnerabilities" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:40:15,897 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:15 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2 HTTP/1.0" 200 47917 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2?tab=vulnerabilities" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:15 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2 HTTP/2.0" 200 47917 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2?tab=vulnerabilities" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.575 574 0.574) repositorygcworker stdout | 2021-11-08 14:40:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:16 UTC)" (scheduled at 2021-11-08 14:40:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:40:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:40:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:47 UTC)" (scheduled at 2021-11-08 14:40:17.787050+00:00) securityworker stdout | 2021-11-08 14:40:17,809 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:40:17,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 14:40:17,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:40:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 14:40:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 14:40:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 14:40:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 14:40:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 336-376 securityworker stdout | 2021-11-08 14:40:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:40:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 14:40:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 14:40:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 391-431 securityworker stdout | 2021-11-08 14:40:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 14:40:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 431-464 securityworker stdout | 2021-11-08 14:40:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 14:40:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:40:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 14:40:17,842 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:40:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:40:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:40:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 14:40:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 14:40:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:40:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:40:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 14:40:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:40:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 14:40:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 14:40:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:40:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 14:40:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:40:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 14:40:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:40:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 14:40:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 436-464 securityworker stdout | 2021-11-08 14:40:17,879 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:40:17,889 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block gunicorn-web stdout | 2021-11-08 14:40:18,692 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:18 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2/security?vulnerabilities=true HTTP/1.0" 200 946879 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2?tab=vulnerabilities" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:18 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2/security?vulnerabilities=true HTTP/2.0" 200 946879 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2?tab=vulnerabilities" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (2.846 472 2.757) notificationworker stdout | 2021-11-08 14:40:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:30 UTC)" (scheduled at 2021-11-08 14:40:20.322052+00:00) notificationworker stdout | 2021-11-08 14:40:20,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:40:20,508 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:40:20,509 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:40:20,510 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:47 UTC)" executed successfully blobuploadcleanupworker stdout | 2021-11-08 14:40:21,300 [62] [INFO] [apscheduler.executors.default] Running job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2021-11-08 14:40:21 UTC)" (scheduled at 2021-11-08 14:40:21.299406+00:00) blobuploadcleanupworker stdout | 2021-11-08 14:40:21,301 [62] [INFO] [apscheduler.executors.default] Job "BlobUploadCleanupWorker._try_cleanup_uploads (trigger: interval[1:00:00], next run at: 2021-11-08 15:40:21 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:40:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:51 UTC)" (scheduled at 2021-11-08 14:40:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:40:21,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:40:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:52 UTC)" (scheduled at 2021-11-08 14:40:22.617060+00:00) gcworker stdout | 2021-11-08 14:40:22,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:40:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:25 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:40:25,497 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:25 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:40:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:27 UTC)" (scheduled at 2021-11-08 14:40:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:40:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:40:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:40 UTC)" (scheduled at 2021-11-08 14:40:30.322052+00:00) notificationworker stdout | 2021-11-08 14:40:30,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:40:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:50 UTC)" (scheduled at 2021-11-08 14:40:40.322052+00:00) notificationworker stdout | 2021-11-08 14:40:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:40:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:40:44 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.003) gunicorn-registry stdout | 2021-11-08 14:40:44,498 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:40:44 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:40:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:17 UTC)" (scheduled at 2021-11-08 14:40:47.787050+00:00) securityworker stdout | 2021-11-08 14:40:47,808 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 14:40:47,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 434-464 securityworker stdout | 2021-11-08 14:40:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 14:40:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:40:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:40:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 14:40:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 14:40:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:40:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 14:40:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 14:40:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 14:40:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 158-198 securityworker stdout | 2021-11-08 14:40:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 14:40:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:40:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 14:40:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 14:40:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 14:40:47,842 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:40:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:40:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 14:40:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 14:40:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:40:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 14:40:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 14:40:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:40:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 14:40:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 14:40:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:40:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 14:40:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:40:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 14:40:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:40:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:40:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 14:40:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 14:40:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 14:40:47,882 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:40:47,891 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 14:40:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:45:49 UTC)" (scheduled at 2021-11-08 14:40:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 14:40:49,497 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:45:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:40:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:00 UTC)" (scheduled at 2021-11-08 14:40:50.322052+00:00) notificationworker stdout | 2021-11-08 14:40:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:40:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:50 UTC)" (scheduled at 2021-11-08 14:40:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:40:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:40:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:21 UTC)" (scheduled at 2021-11-08 14:40:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:40:51,819 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:40:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:22 UTC)" (scheduled at 2021-11-08 14:40:52.617060+00:00) gcworker stdout | 2021-11-08 14:40:52,649 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:40:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:54 UTC)" (scheduled at 2021-11-08 14:40:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:40:54,192 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:40:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:55 UTC)" (scheduled at 2021-11-08 14:40:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:40:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:41:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:40:57,502 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:40:57,502 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:40:57,503 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:41:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:10 UTC)" (scheduled at 2021-11-08 14:41:00.322052+00:00) notificationworker stdout | 2021-11-08 14:41:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:41:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 14:41:04,337 [233] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:41:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 14:41:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:06 UTC)" (scheduled at 2021-11-08 14:41:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:41:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:41:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:09 UTC)" (scheduled at 2021-11-08 14:41:09.376681+00:00) notificationworker stdout | 2021-11-08 14:41:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:41:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:20 UTC)" (scheduled at 2021-11-08 14:41:10.322052+00:00) notificationworker stdout | 2021-11-08 14:41:10,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:41:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:16 UTC)" (scheduled at 2021-11-08 14:41:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:41:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:41:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:47 UTC)" (scheduled at 2021-11-08 14:41:17.787050+00:00) securityworker stdout | 2021-11-08 14:41:17,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:41:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:41:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:41:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 14:41:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:41:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 14:41:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 14:41:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:41:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 14:41:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 14:41:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 9-49 securityworker stdout | 2021-11-08 14:41:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 14:41:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 14:41:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:41:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 199-239 securityworker stdout | 2021-11-08 14:41:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 14:41:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 435-464 securityworker stdout | 2021-11-08 14:41:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 14:41:17,856 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:41:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:41:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 14:41:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 14:41:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 14:41:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 237-277 securityworker stdout | 2021-11-08 14:41:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 14:41:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:41:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 14:41:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 14:41:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 14:41:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 14:41:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:41:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:41:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:41:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:41:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 14:41:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 14:41:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 14:41:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 442-464 securityworker stdout | 2021-11-08 14:41:17,898 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:41:17,908 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:41:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:30 UTC)" (scheduled at 2021-11-08 14:41:20.322052+00:00) notificationworker stdout | 2021-11-08 14:41:20,345 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:41:21,511 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:41:21,511 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:41:21,512 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:41:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:51 UTC)" (scheduled at 2021-11-08 14:41:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:41:21,819 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:41:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:52 UTC)" (scheduled at 2021-11-08 14:41:22.617060+00:00) gcworker stdout | 2021-11-08 14:41:22,650 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:41:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:41:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:27 UTC)" (scheduled at 2021-11-08 14:41:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:41:27,913 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:41:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:40 UTC)" (scheduled at 2021-11-08 14:41:30.322052+00:00) notificationworker stdout | 2021-11-08 14:41:30,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:41:31 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.078 325 0.078) gunicorn-registry stdout | 2021-11-08 14:41:31,599 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:41:31 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:41:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:50 UTC)" (scheduled at 2021-11-08 14:41:40.322052+00:00) notificationworker stdout | 2021-11-08 14:41:40,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:41:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:41:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:17 UTC)" (scheduled at 2021-11-08 14:41:47.787050+00:00) securityworker stdout | 2021-11-08 14:41:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:41:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 14:41:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:41:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 32-72 securityworker stdout | 2021-11-08 14:41:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 204-244 securityworker stdout | 2021-11-08 14:41:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:41:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 14:41:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 14:41:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:41:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 14:41:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:41:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 14:41:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:41:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 429-464 securityworker stdout | 2021-11-08 14:41:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 14:41:47,898 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:41:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 37-77 securityworker stdout | 2021-11-08 14:41:47,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:41:47,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 14:41:47,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 14:41:47,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 14:41:47,914 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:41:47,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 77-117 securityworker stdout | 2021-11-08 14:41:47,919 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 276-316 securityworker stdout | 2021-11-08 14:41:47,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 232-272 securityworker stdout | 2021-11-08 14:41:47,924 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 272-312 securityworker stdout | 2021-11-08 14:41:47,927 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 14:41:47,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:41:47,933 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 14:41:47,936 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:41:47,939 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:41:47,942 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 14:41:47,944 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:41:47,944 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:41:47,951 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block gunicorn-registry stdout | 2021-11-08 14:41:48,626 [241] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:41:48 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:41:48 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.179 325 0.179) securityworker stdout | 2021-11-08 14:41:50,067 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:41:50,067 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:41:50,068 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:41:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:00 UTC)" (scheduled at 2021-11-08 14:41:50.322052+00:00) notificationworker stdout | 2021-11-08 14:41:50,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:41:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:50 UTC)" (scheduled at 2021-11-08 14:41:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:41:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:41:50,684 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:41:50 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:41:50 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.122 325 0.121) buildlogsarchiver stdout | 2021-11-08 14:41:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:21 UTC)" (scheduled at 2021-11-08 14:41:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:41:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:41:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:22 UTC)" (scheduled at 2021-11-08 14:41:52.617060+00:00) gcworker stdout | 2021-11-08 14:41:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:41:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:54 UTC)" (scheduled at 2021-11-08 14:41:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:41:54,181 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:41:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:55 UTC)" (scheduled at 2021-11-08 14:41:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:41:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:42:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:42:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:10 UTC)" (scheduled at 2021-11-08 14:42:00.322052+00:00) notificationworker stdout | 2021-11-08 14:42:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:10 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:42:04,626 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:42:04 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:42:04 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.104 325 0.104) exportactionlogsworker stdout | 2021-11-08 14:42:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:06 UTC)" (scheduled at 2021-11-08 14:42:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:42:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:42:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:09 UTC)" (scheduled at 2021-11-08 14:42:09.376681+00:00) notificationworker stdout | 2021-11-08 14:42:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:42:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:20 UTC)" (scheduled at 2021-11-08 14:42:10.322052+00:00) notificationworker stdout | 2021-11-08 14:42:10,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:20 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:42:14,397 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:42:14 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:42:14 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.099 325 0.099) nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:42:16 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.086 325 0.086) gunicorn-registry stdout | 2021-11-08 14:42:16,031 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:42:16 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 14:42:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:16 UTC)" (scheduled at 2021-11-08 14:42:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:42:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:42:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:47 UTC)" (scheduled at 2021-11-08 14:42:17.787050+00:00) securityworker stdout | 2021-11-08 14:42:17,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 14:42:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 18-58 securityworker stdout | 2021-11-08 14:42:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 14:42:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 14:42:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 14:42:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:42:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:42:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 14:42:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:42:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 14:42:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 14:42:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 14:42:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 14:42:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 14:42:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 14:42:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 14:42:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 14:42:17,850 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:42:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:42:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:42:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 14:42:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 14:42:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 34-74 securityworker stdout | 2021-11-08 14:42:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 14:42:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:42:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 14:42:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:42:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 14:42:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:42:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:42:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:42:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 14:42:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 14:42:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 14:42:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 430-464 securityworker stdout | 2021-11-08 14:42:17,890 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:42:17,898 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 14:42:19,155 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:42:19,155 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:42:19,156 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:42:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:30 UTC)" (scheduled at 2021-11-08 14:42:20.322052+00:00) notificationworker stdout | 2021-11-08 14:42:20,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:42:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:51 UTC)" (scheduled at 2021-11-08 14:42:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:42:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:42:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:52 UTC)" (scheduled at 2021-11-08 14:42:22.617060+00:00) gcworker stdout | 2021-11-08 14:42:22,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:42:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:42:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:27 UTC)" (scheduled at 2021-11-08 14:42:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:42:27,898 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:42:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:40 UTC)" (scheduled at 2021-11-08 14:42:30.322052+00:00) notificationworker stdout | 2021-11-08 14:42:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:42:40,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:50 UTC)" (scheduled at 2021-11-08 14:42:40.322052+00:00) notificationworker stdout | 2021-11-08 14:42:40,355 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:42:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:42:45 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.112 325 0.111) gunicorn-registry stdout | 2021-11-08 14:42:45,743 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:42:45 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:42:46,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:47:46 UTC)" (scheduled at 2021-11-08 14:42:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:42:46,153 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:47:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:42:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:17 UTC)" (scheduled at 2021-11-08 14:42:47.787050+00:00) securityworker stdout | 2021-11-08 14:42:47,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:42:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:42:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:42:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:42:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:42:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:42:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 14:42:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:42:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 14:42:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:42:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:42:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:42:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:42:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:42:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:42:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 14:42:47,842 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:42:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:42:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 133-173 securityworker stdout | 2021-11-08 14:42:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 14:42:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:42:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:42:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:42:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:42:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:42:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 14:42:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 173-213 securityworker stdout | 2021-11-08 14:42:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 14:42:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:42:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 14:42:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:42:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 14:42:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 14:42:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 14:42:47,885 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:42:47,893 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 14:42:49,638 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:42:49,639 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:42:49,640 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:42:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:00 UTC)" (scheduled at 2021-11-08 14:42:50.322052+00:00) notificationworker stdout | 2021-11-08 14:42:50,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:42:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:50 UTC)" (scheduled at 2021-11-08 14:42:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:42:50,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:42:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:21 UTC)" (scheduled at 2021-11-08 14:42:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:42:51,947 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:42:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:47:52 UTC)" (scheduled at 2021-11-08 14:42:52.376404+00:00) notificationworker stdout | 2021-11-08 14:42:52,398 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:47:52 UTC)" executed successfully gcworker stdout | 2021-11-08 14:42:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:22 UTC)" (scheduled at 2021-11-08 14:42:52.617060+00:00) gunicorn-registry stdout | 2021-11-08 14:42:52,627 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:42:52 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:42:52 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.093 325 0.093) gcworker stdout | 2021-11-08 14:42:52,637 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:42:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:54 UTC)" (scheduled at 2021-11-08 14:42:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:42:54,186 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:54 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:42:54,329 [230] [INFO] [gunicorn.access] 10.100.102.3 - c21533+testmirror [08/Nov/2021:14:42:54 +0000] "GET /v2/auth?account=c21533%2Btestmirror&scope=repository%3Ac21533%2Ftest%3Apull%2Cpush&service=enterprisequay.rblbank.com HTTP/1.1" 200 1017 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - c21533+testmirror [08/Nov/2021:14:42:54 +0000] "GET /v2/auth?account=c21533%2Btestmirror&scope=repository%3Ac21533%2Ftest%3Apull%2Cpush&service=enterprisequay.rblbank.com HTTP/1.1" 200 1017 "-" "skopeo/1.3.2-dev" (0.075 376 0.075) gunicorn-registry stdout | 2021-11-08 14:42:54,415 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:42:54 +0000] "HEAD /v2/c21533/test/blobs/sha256:c65299f2847308dc8c08513a39bb25252e98a01f3b6556ed3187eca2f20da3d4 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:42:54 +0000] "HEAD /v2/c21533/test/blobs/sha256:c65299f2847308dc8c08513a39bb25252e98a01f3b6556ed3187eca2f20da3d4 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.022 1269 0.022) namespacegcworker stdout | 2021-11-08 14:42:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:55 UTC)" (scheduled at 2021-11-08 14:42:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:42:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:43:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:42:56 +0000] "HEAD /v2/c21533/test/blobs/sha256:3c380a0657437c068edbdf33272b3f1533c7e6156431911250de6e3db1791b27 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.027 1269 0.027) gunicorn-registry stdout | 2021-11-08 14:42:56,196 [232] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:42:56 +0000] "HEAD /v2/c21533/test/blobs/sha256:3c380a0657437c068edbdf33272b3f1533c7e6156431911250de6e3db1791b27 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" gunicorn-registry stdout | 2021-11-08 14:42:56,690 [231] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:42:56 +0000] "PUT /v2/c21533/test/manifests/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647 HTTP/1.1" 201 2 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:42:56 +0000] "PUT /v2/c21533/test/manifests/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647 HTTP/1.1" 201 2 "-" "skopeo/1.3.2-dev" (0.095 2121 0.094) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:00 +0000] "HEAD /v2/c21533/test/blobs/sha256:72b6d8cae3b9c95f65024d9681ec0f425eaf73bf9a421322f7f23ed24e42c69c HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.083 1269 0.083) gunicorn-registry stdout | 2021-11-08 14:43:00,275 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:00 +0000] "HEAD /v2/c21533/test/blobs/sha256:72b6d8cae3b9c95f65024d9681ec0f425eaf73bf9a421322f7f23ed24e42c69c HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" notificationworker stdout | 2021-11-08 14:43:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:10 UTC)" (scheduled at 2021-11-08 14:43:00.322052+00:00) notificationworker stdout | 2021-11-08 14:43:00,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:43:00,386 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:43:00,419 [235] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} gunicorn-registry stdout | 2021-11-08 14:43:00,420 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:00 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:00 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 272 0.003) exportactionlogsworker stdout | 2021-11-08 14:43:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:06 UTC)" (scheduled at 2021-11-08 14:43:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:43:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:43:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:09 UTC)" (scheduled at 2021-11-08 14:43:09.376681+00:00) notificationworker stdout | 2021-11-08 14:43:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:43:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:20 UTC)" (scheduled at 2021-11-08 14:43:10.322052+00:00) notificationworker stdout | 2021-11-08 14:43:10,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:43:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:48:14 UTC)" (scheduled at 2021-11-08 14:43:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:43:14,975 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:48:14 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:43:16,825 [244] [INFO] [gunicorn.access] 10.100.102.3 - demoorg+reposyncdcuser [08/Nov/2021:14:43:16 +0000] "GET /v2/auth?account=demoorg%2Breposyncdcuser&scope=repository%3Ademoorg%2Fubi-mirror%3Apull%2Cpush&service=enterprisequay.rblbank.com HTTP/1.1" 200 1055 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - demoorg+reposyncdcuser [08/Nov/2021:14:43:16 +0000] "GET /v2/auth?account=demoorg%2Breposyncdcuser&scope=repository%3Ademoorg%2Fubi-mirror%3Apull%2Cpush&service=enterprisequay.rblbank.com HTTP/1.1" 200 1055 "-" "skopeo/1.3.2-dev" (0.078 392 0.078) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:16 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:0bcb99761896a3a40af77321f68dce0f550081004f95ccca45134a46bfa9ad71 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.023 1314 0.023) gunicorn-registry stdout | 2021-11-08 14:43:16,872 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:16 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:0bcb99761896a3a40af77321f68dce0f550081004f95ccca45134a46bfa9ad71 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" repositorygcworker stdout | 2021-11-08 14:43:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:16 UTC)" (scheduled at 2021-11-08 14:43:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:43:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:43:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:47 UTC)" (scheduled at 2021-11-08 14:43:17.787050+00:00) securityworker stdout | 2021-11-08 14:43:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:43:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 14:43:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 35-75 securityworker stdout | 2021-11-08 14:43:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:43:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 14:43:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:43:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 14:43:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:43:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 14:43:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 14:43:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 14:43:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 14:43:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 14:43:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 14:43:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 14:43:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 14:43:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 14:43:17,871 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:43:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 14:43:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 14:43:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 36-76 securityworker stdout | 2021-11-08 14:43:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:43:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 14:43:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:43:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:43:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 14:43:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 14:43:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:43:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:43:17,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 14:43:17,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:43:17,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 14:43:17,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 14:43:17,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 14:43:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 454-464 securityworker stdout | 2021-11-08 14:43:17,913 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:43:17,924 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:43:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:30 UTC)" (scheduled at 2021-11-08 14:43:20.322052+00:00) notificationworker stdout | 2021-11-08 14:43:20,370 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:30 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:43:20,569 [232] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:20 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:20 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:21 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:539a6eaa8da545712f4839c6f9f9b38440ee7450d05d98bb4e0ece3085f26165 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.019 1314 0.019) gunicorn-registry stdout | 2021-11-08 14:43:21,204 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:21 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:539a6eaa8da545712f4839c6f9f9b38440ee7450d05d98bb4e0ece3085f26165 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" buildlogsarchiver stdout | 2021-11-08 14:43:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:51 UTC)" (scheduled at 2021-11-08 14:43:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:43:21,838 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:43:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:52 UTC)" (scheduled at 2021-11-08 14:43:22.617060+00:00) gcworker stdout | 2021-11-08 14:43:22,659 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:52 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:43:22,702 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:22 +0000] "PUT /v2/demoorg/ubi-mirror/manifests/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647 HTTP/1.1" 201 2 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:22 +0000] "PUT /v2/demoorg/ubi-mirror/manifests/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647 HTTP/1.1" 201 2 "-" "skopeo/1.3.2-dev" (0.072 2166 0.036) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:25 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:72b6d8cae3b9c95f65024d9681ec0f425eaf73bf9a421322f7f23ed24e42c69c HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.281 1314 0.280) gunicorn-registry stdout | 2021-11-08 14:43:25,345 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:25 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:72b6d8cae3b9c95f65024d9681ec0f425eaf73bf9a421322f7f23ed24e42c69c HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" namespacegcworker stdout | 2021-11-08 14:43:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:27 UTC)" (scheduled at 2021-11-08 14:43:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:43:27,912 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:43:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:40 UTC)" (scheduled at 2021-11-08 14:43:30.322052+00:00) notificationworker stdout | 2021-11-08 14:43:30,342 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:43:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:50 UTC)" (scheduled at 2021-11-08 14:43:40.322052+00:00) notificationworker stdout | 2021-11-08 14:43:40,495 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:43:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:43:41,714 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:43:41,714 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:43:41,716 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:43:47 UTC)" executed successfully securityworker stdout | 2021-11-08 14:43:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:17 UTC)" (scheduled at 2021-11-08 14:43:47.787050+00:00) securityworker stdout | 2021-11-08 14:43:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 14:43:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 14:43:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 14:43:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:43:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 14:43:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 14:43:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 14:43:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:43:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:43:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:43:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 14:43:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:43:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 14:43:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 14:43:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 14:43:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 14:43:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 14:43:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 14:43:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 14:43:47,848 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:43:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:43:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 14:43:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 14:43:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:43:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:43:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 14:43:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 14:43:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:43:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 14:43:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 14:43:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 14:43:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:43:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:43:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 14:43:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 14:43:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 14:43:47,881 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:43:47,889 [102] [INFO] [util.migrate.allocator] Found 34 candidates, processing block notificationworker stdout | 2021-11-08 14:43:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:00 UTC)" (scheduled at 2021-11-08 14:43:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:43:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:50 UTC)" (scheduled at 2021-11-08 14:43:50.393684+00:00) notificationworker stdout | 2021-11-08 14:43:50,406 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:43:50,415 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:43:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:21 UTC)" (scheduled at 2021-11-08 14:43:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:43:51,873 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:43:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:22 UTC)" (scheduled at 2021-11-08 14:43:52.617060+00:00) gcworker stdout | 2021-11-08 14:43:52,657 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:22 UTC)" executed successfully securityworker stdout | 2021-11-08 14:43:53,982 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:43:53,982 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:43:53,983 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:43:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:54 UTC)" (scheduled at 2021-11-08 14:43:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:43:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:43:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:55 UTC)" (scheduled at 2021-11-08 14:43:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:43:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:44:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:58 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm?includeStats=true&includeTags=false HTTP/2.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.426 77 0.425) gunicorn-web stdout | 2021-11-08 14:43:58,673 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:58 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm?includeStats=true&includeTags=false HTTP/1.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:58 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.433 922 0.432) gunicorn-web stdout | 2021-11-08 14:43:58,680 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:58 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:59 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.070 129 0.070) gunicorn-web stdout | 2021-11-08 14:43:59,209 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:59 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:43:59 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.061 408 0.061) gunicorn-web stdout | 2021-11-08 14:43:59,345 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:43:59 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:44:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:10 UTC)" (scheduled at 2021-11-08 14:44:00.322052+00:00) notificationworker stdout | 2021-11-08 14:44:00,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:10 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:44:02,495 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:863e09b600030be272b99e063c9bd85b5b5bf3d3b4d4c845e98de055319ac39d/security?vulnerabilities=true HTTP/1.0" 200 946879 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:863e09b600030be272b99e063c9bd85b5b5bf3d3b4d4c845e98de055319ac39d/security?vulnerabilities=true HTTP/2.0" 200 946879 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (3.419 130 3.355) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.049 448 0.049) gunicorn-web stdout | 2021-11-08 14:44:02,767 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:44:02,792 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.076 78 0.076) gunicorn-web stdout | 2021-11-08 14:44:02,802 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.082 91 0.082) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.082 92 0.082) gunicorn-web stdout | 2021-11-08 14:44:02,803 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.123 89 0.123) gunicorn-web stdout | 2021-11-08 14:44:02,840 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:44:02,952 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:02 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:ff6563f0c17435ee75f82581f2aeb0a859586ee2e7f9c4e3d886bedf68bf4290/security?vulnerabilities=true HTTP/1.0" 200 941082 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:03 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:ff6563f0c17435ee75f82581f2aeb0a859586ee2e7f9c4e3d886bedf68bf4290/security?vulnerabilities=true HTTP/2.0" 200 941082 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (3.872 474 3.817) gunicorn-web stdout | 2021-11-08 14:44:03,277 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:03 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:0af14d73008fda0f2f7601453ccf022a3317316051d6023ea679853b77e20b98/security?vulnerabilities=true HTTP/1.0" 200 941082 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:03 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:0af14d73008fda0f2f7601453ccf022a3317316051d6023ea679853b77e20b98/security?vulnerabilities=true HTTP/2.0" 200 941082 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (4.200 129 4.140) exportactionlogsworker stdout | 2021-11-08 14:44:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:06 UTC)" (scheduled at 2021-11-08 14:44:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:44:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:44:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:09 UTC)" (scheduled at 2021-11-08 14:44:09.376681+00:00) notificationworker stdout | 2021-11-08 14:44:09,378 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:44:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:20 UTC)" (scheduled at 2021-11-08 14:44:10.322052+00:00) notificationworker stdout | 2021-11-08 14:44:10,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:20 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:44:12,100 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:12 +0000] "GET /api/v1/organization/demoorg HTTP/1.0" 200 662 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:12 +0000] "GET /api/v1/organization/demoorg HTTP/2.0" 200 662 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (5.066 426 5.066) gunicorn-web stdout | 2021-11-08 14:44:12,429 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:12 +0000] "GET /api/v1/organization/demoorg/prototypes HTTP/1.0" 200 19 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:12 +0000] "GET /api/v1/organization/demoorg/prototypes HTTP/2.0" 200 19 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.058 394 0.058) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:12 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.073 456 0.073) gunicorn-web stdout | 2021-11-08 14:44:12,482 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:12 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/organization/demoorg" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 14:44:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:16 UTC)" (scheduled at 2021-11-08 14:44:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:44:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:16 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:17 +0000] "GET /api/v1/organization/demoorg/applications HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/organization/demoorg?tab=applications" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.073 165 0.073) gunicorn-web stdout | 2021-11-08 14:44:17,255 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:17 +0000] "GET /api/v1/organization/demoorg/applications HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/organization/demoorg?tab=applications" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:44:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:47 UTC)" (scheduled at 2021-11-08 14:44:17.787050+00:00) securityworker stdout | 2021-11-08 14:44:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 14:44:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 14:44:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 14:44:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:44:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 260-300 securityworker stdout | 2021-11-08 14:44:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 14:44:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 24-64 securityworker stdout | 2021-11-08 14:44:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 14:44:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 300-340 securityworker stdout | 2021-11-08 14:44:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:44:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:44:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 14:44:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:44:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:44:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:44:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 14:44:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:44:17,869 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:44:17,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 14:44:17,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 14:44:17,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 14:44:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 14:44:17,916 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 35-75 securityworker stdout | 2021-11-08 14:44:17,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 14:44:17,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 14:44:17,924 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:44:17,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 14:44:17,927 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 14:44:17,929 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 193-233 securityworker stdout | 2021-11-08 14:44:17,931 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 14:44:17,934 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:44:17,936 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 14:44:17,938 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 14:44:17,940 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 14:44:17,940 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:44:17,952 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block gunicorn-web stdout | 2021-11-08 14:44:19,090 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:19 +0000] "GET /api/v1/organization/demoorg/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 87330 "https://enterprisequay.rblbank.com/organization/demoorg?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:19 +0000] "GET /api/v1/organization/demoorg/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 87330 "https://enterprisequay.rblbank.com/organization/demoorg?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.187 77 0.187) gunicorn-web stdout | 2021-11-08 14:44:19,534 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:19 +0000] "GET /api/v1/organization/demoorg/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3229 "https://enterprisequay.rblbank.com/organization/demoorg?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:19 +0000] "GET /api/v1/organization/demoorg/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3229 "https://enterprisequay.rblbank.com/organization/demoorg?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.633 475 0.633) securityworker stdout | 2021-11-08 14:44:20,147 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:44:20,147 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:44:20,148 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:44:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:30 UTC)" (scheduled at 2021-11-08 14:44:20.322052+00:00) notificationworker stdout | 2021-11-08 14:44:20,608 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:44:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:51 UTC)" (scheduled at 2021-11-08 14:44:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:44:22,061 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:44:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:52 UTC)" (scheduled at 2021-11-08 14:44:22.617060+00:00) gcworker stdout | 2021-11-08 14:44:22,833 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:44:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 461 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.239 469 0.238) gunicorn-web stdout | 2021-11-08 14:44:25,455 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 461 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:44:25,520 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror?includeStats=true&includeTags=false HTTP/1.0" 200 3637 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror?includeStats=true&includeTags=false HTTP/2.0" 200 3637 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.304 73 0.303) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/2.0" 200 537 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.086 397 0.086) gunicorn-web stdout | 2021-11-08 14:44:25,797 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/1.0" 200 537 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:26 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.047 59 0.047) gunicorn-web stdout | 2021-11-08 14:44:26,020 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:26 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:27 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/notification/ HTTP/2.0" 200 22 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=settings" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.060 57 0.060) gunicorn-web stdout | 2021-11-08 14:44:27,490 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:27 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/notification/ HTTP/1.0" 200 22 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=settings" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:27 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/permissions/user/ HTTP/2.0" 200 525 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=settings" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.069 461 0.069) gunicorn-web stdout | 2021-11-08 14:44:27,496 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:27 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/permissions/user/ HTTP/1.0" 200 525 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=settings" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:44:27,537 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:27 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/permissions/team/ HTTP/1.0" 200 20 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=settings" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:27 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/permissions/team/ HTTP/2.0" 200 20 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=settings" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.109 60 0.109) namespacegcworker stdout | 2021-11-08 14:44:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:27 UTC)" (scheduled at 2021-11-08 14:44:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:44:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:44:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:40 UTC)" (scheduled at 2021-11-08 14:44:30.322052+00:00) notificationworker stdout | 2021-11-08 14:44:30,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:37 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.020 1689 0.020) gunicorn-registry stdout | 2021-11-08 14:44:37,508 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:37 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:44:39,846 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:39 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:39 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.025 1690 0.025) notificationworker stdout | 2021-11-08 14:44:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:50 UTC)" (scheduled at 2021-11-08 14:44:40.322052+00:00) notificationworker stdout | 2021-11-08 14:44:40,686 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:44:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:46 +0000] "POST /api/v1/repository/demoorg/ubi-mirror/mirror/sync-now HTTP/2.0" 204 0 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.056 529 0.055) gunicorn-web stdout | 2021-11-08 14:44:46,397 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:46 +0000] "POST /api/v1/repository/demoorg/ubi-mirror/mirror/sync-now HTTP/1.0" 204 0 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:46 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/2.0" 200 538 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.039 771 0.039) gunicorn-web stdout | 2021-11-08 14:44:46,449 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:46 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/1.0" 200 538 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:44:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:17 UTC)" (scheduled at 2021-11-08 14:44:47.787050+00:00) securityworker stdout | 2021-11-08 14:44:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 264-304 securityworker stdout | 2021-11-08 14:44:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 14:44:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 14:44:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:44:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 14:44:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 14:44:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 98-138 securityworker stdout | 2021-11-08 14:44:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 14:44:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:44:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:44:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:44:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 217-257 securityworker stdout | 2021-11-08 14:44:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 14:44:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:44:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 14:44:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:44:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 14:44:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:44:47,851 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:44:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 14:44:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:44:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 14:44:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:44:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 14:44:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 14:44:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:44:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 14:44:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 14:44:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 276-316 securityworker stdout | 2021-11-08 14:44:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 14:44:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 14:44:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 14:44:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 14:44:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 gunicorn-web stdout | 2021-11-08 14:44:47,889 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:47 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:44:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 14:44:47,887 [102] [INFO] [util.migrate.allocator] No more work nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:47 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.096 47 0.096) securityworker stdout | 2021-11-08 14:44:47,895 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block gunicorn-web stdout | 2021-11-08 14:44:47,957 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:47 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:47 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.165 102 0.165) gunicorn-web stdout | 2021-11-08 14:44:49,716 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:49 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 71231 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:49 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 71231 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.066 83 0.066) notificationworker stdout | 2021-11-08 14:44:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:00 UTC)" (scheduled at 2021-11-08 14:44:50.322052+00:00) notificationworker stdout | 2021-11-08 14:44:50,349 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:44:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:50 UTC)" (scheduled at 2021-11-08 14:44:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:44:50,423 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:50 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:44:50,645 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:50 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:50 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.995 487 0.995) buildlogsarchiver stdout | 2021-11-08 14:44:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:21 UTC)" (scheduled at 2021-11-08 14:44:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:44:52,037 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:44:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:22 UTC)" (scheduled at 2021-11-08 14:44:52.617060+00:00) gcworker stdout | 2021-11-08 14:44:52,675 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:22 UTC)" executed successfully securityworker stdout | 2021-11-08 14:44:53,690 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:44:53,690 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:44:53,691 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:44:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:54 UTC)" (scheduled at 2021-11-08 14:44:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:44:54,300 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:44:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:55 UTC)" (scheduled at 2021-11-08 14:44:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:44:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:45:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:44:56 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.114 404 0.114) gunicorn-web stdout | 2021-11-08 14:44:56,214 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:44:56 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:45:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:10 UTC)" (scheduled at 2021-11-08 14:45:00.322052+00:00) notificationworker stdout | 2021-11-08 14:45:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:10 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:45:02,675 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 71231 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 71231 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.054 83 0.053) gunicorn-web stdout | 2021-11-08 14:45:02,702 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.081 433 0.080) exportactionlogsworker stdout | 2021-11-08 14:45:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:06 UTC)" (scheduled at 2021-11-08 14:45:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:45:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:06 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:45:08,755 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:08 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:08 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.174 1690 0.174) notificationworker stdout | 2021-11-08 14:45:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:09 UTC)" (scheduled at 2021-11-08 14:45:09.376681+00:00) notificationworker stdout | 2021-11-08 14:45:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:45:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:20 UTC)" (scheduled at 2021-11-08 14:45:10.322052+00:00) notificationworker stdout | 2021-11-08 14:45:10,345 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - demoorg+reposyncdcuser [08/Nov/2021:14:45:14 +0000] "GET /v2/auth?account=demoorg%2Breposyncdcuser&scope=repository%3Ademoorg%2Fubi-mirror%3Apull%2Cpush&service=enterprisequay.rblbank.com HTTP/1.1" 200 1055 "-" "skopeo/1.3.2-dev" (0.612 392 0.612) gunicorn-registry stdout | 2021-11-08 14:45:14,211 [230] [INFO] [gunicorn.access] 10.100.102.3 - demoorg+reposyncdcuser [08/Nov/2021:14:45:14 +0000] "GET /v2/auth?account=demoorg%2Breposyncdcuser&scope=repository%3Ademoorg%2Fubi-mirror%3Apull%2Cpush&service=enterprisequay.rblbank.com HTTP/1.1" 200 1055 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:14 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:6f683d6ef7a8199fdabf203f98cce97d628e40eefa42b7085f1f151d384a97fc HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.137 1314 0.138) gunicorn-registry stdout | 2021-11-08 14:45:14,768 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:14 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:6f683d6ef7a8199fdabf203f98cce97d628e40eefa42b7085f1f151d384a97fc HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:15 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:3c380a0657437c068edbdf33272b3f1533c7e6156431911250de6e3db1791b27 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.137 1314 0.137) gunicorn-registry stdout | 2021-11-08 14:45:15,345 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:15 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:3c380a0657437c068edbdf33272b3f1533c7e6156431911250de6e3db1791b27 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:16 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:0d5ae886b650ea8cd2b4e267c716e7f36324dfff8de39361ee9d1e0aa43e889c HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.020 1314 0.020) gunicorn-registry stdout | 2021-11-08 14:45:16,357 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:16 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:0d5ae886b650ea8cd2b4e267c716e7f36324dfff8de39361ee9d1e0aa43e889c HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" gunicorn-registry stdout | 2021-11-08 14:45:16,797 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:16 +0000] "PUT /v2/demoorg/ubi-mirror/manifests/sha256:072eb8636ab29d31123c1ce3b862ad33ef3d73628fc23b3e91e25934ec97aea2 HTTP/1.1" 201 2 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:16 +0000] "PUT /v2/demoorg/ubi-mirror/manifests/sha256:072eb8636ab29d31123c1ce3b862ad33ef3d73628fc23b3e91e25934ec97aea2 HTTP/1.1" 201 2 "-" "skopeo/1.3.2-dev" (0.030 2166 0.018) repositorygcworker stdout | 2021-11-08 14:45:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:16 UTC)" (scheduled at 2021-11-08 14:45:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:45:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:45:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:47 UTC)" (scheduled at 2021-11-08 14:45:17.787050+00:00) securityworker stdout | 2021-11-08 14:45:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 14:45:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:45:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 14:45:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 14:45:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 14-54 securityworker stdout | 2021-11-08 14:45:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 14:45:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:45:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 98-138 securityworker stdout | 2021-11-08 14:45:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 14:45:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 14:45:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 14:45:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 14:45:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 14:45:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 14:45:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 442-464 securityworker stdout | 2021-11-08 14:45:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 14:45:17,860 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:45:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 14:45:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 14:45:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 14:45:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 14:45:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 14:45:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 14-54 securityworker stdout | 2021-11-08 14:45:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 14:45:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 14:45:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:45:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:45:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 14:45:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 14:45:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:45:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 14:45:17,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 14:45:17,953 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 14:45:17,958 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 14:45:17,961 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 14:45:17,961 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:45:17,966 [102] [INFO] [util.migrate.allocator] Found 5 candidates, processing block notificationworker stdout | 2021-11-08 14:45:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:30 UTC)" (scheduled at 2021-11-08 14:45:20.322052+00:00) notificationworker stdout | 2021-11-08 14:45:20,351 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:45:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:51 UTC)" (scheduled at 2021-11-08 14:45:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:45:21,834 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:51 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:22 +0000] "PUT /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/2.0" 201 3 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.086 433 0.086) gunicorn-web stdout | 2021-11-08 14:45:22,605 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:22 +0000] "PUT /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/1.0" 201 3 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gcworker stdout | 2021-11-08 14:45:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:52 UTC)" (scheduled at 2021-11-08 14:45:22.617060+00:00) gcworker stdout | 2021-11-08 14:45:22,652 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:22 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/2.0" 200 539 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.064 461 0.064) gunicorn-web stdout | 2021-11-08 14:45:22,763 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:22 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/1.0" 200 539 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:45:25,281 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.204 464 0.204) gunicorn-web stdout | 2021-11-08 14:45:25,302 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 82080 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:25 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 82080 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.224 83 0.224) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:45:26 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.071 404 0.070) gunicorn-web stdout | 2021-11-08 14:45:26,384 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:45:26 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:45:26 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.298 325 0.298) gunicorn-registry stdout | 2021-11-08 14:45:26,996 [231] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:45:26 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:45:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:27 UTC)" (scheduled at 2021-11-08 14:45:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:45:27,988 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:45:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:40 UTC)" (scheduled at 2021-11-08 14:45:30.322052+00:00) notificationworker stdout | 2021-11-08 14:45:30,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:40 UTC)" executed successfully globalpromstats stdout | 2021-11-08 14:45:31,868 [70] [INFO] [apscheduler.executors.default] Running job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2021-11-08 14:45:31 UTC)" (scheduled at 2021-11-08 14:45:31.867274+00:00) globalpromstats stdout | 2021-11-08 14:45:31,869 [70] [INFO] [apscheduler.executors.default] Job "GlobalPrometheusStatsWorker._try_report_stats (trigger: interval[1:00:00], next run at: 2021-11-08 14:45:31 UTC)" executed successfully securityworker stdout | 2021-11-08 14:45:34,047 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:45:34,047 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:45:34,048 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:45:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:45:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:50 UTC)" (scheduled at 2021-11-08 14:45:40.322052+00:00) notificationworker stdout | 2021-11-08 14:45:40,883 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:45:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:45:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:17 UTC)" (scheduled at 2021-11-08 14:45:47.787050+00:00) securityworker stdout | 2021-11-08 14:45:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 14:45:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:45:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:45:47,940 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 14:45:47,943 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:45:47,945 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:45:47,947 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 14:45:47,950 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:45:47,952 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:45:47,955 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:45:47,957 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:45:47,960 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 14:45:47,962 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:45:47,965 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 381-421 securityworker stdout | 2021-11-08 14:45:47,967 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:45:47,969 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:45:47,971 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:45:47,972 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:45:47,973 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:45:47,975 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 14:45:47,977 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 14:45:47,979 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 14:45:47,982 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 14:45:47,983 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 14:45:47,986 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 14:45:47,988 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:45:47,990 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 269-309 securityworker stdout | 2021-11-08 14:45:47,992 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 14:45:47,994 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 24-64 securityworker stdout | 2021-11-08 14:45:47,997 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:45:48,000 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:45:48,003 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:45:48,006 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:45:48,009 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:45:48,012 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 14:45:48,012 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:45:48,022 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 14:45:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:50:49 UTC)" (scheduled at 2021-11-08 14:45:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 14:45:49,615 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:50:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:45:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:00 UTC)" (scheduled at 2021-11-08 14:45:50.322052+00:00) notificationworker stdout | 2021-11-08 14:45:50,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:45:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:50 UTC)" (scheduled at 2021-11-08 14:45:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:45:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:45:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:21 UTC)" (scheduled at 2021-11-08 14:45:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:45:51,820 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:21 UTC)" executed successfully securityworker stdout | 2021-11-08 14:45:52,341 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:45:52,341 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:45:52,342 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:17 UTC)" executed successfully gcworker stdout | 2021-11-08 14:45:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:22 UTC)" (scheduled at 2021-11-08 14:45:52.617060+00:00) gcworker stdout | 2021-11-08 14:45:52,636 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:45:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:54 UTC)" (scheduled at 2021-11-08 14:45:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:45:54,341 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:54 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:45:55 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.490 325 0.489) gunicorn-registry stdout | 2021-11-08 14:45:55,014 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:45:55 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:45:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:55 UTC)" (scheduled at 2021-11-08 14:45:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:45:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:46:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:46:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:10 UTC)" (scheduled at 2021-11-08 14:46:00.322052+00:00) notificationworker stdout | 2021-11-08 14:46:00,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:46:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:06 UTC)" (scheduled at 2021-11-08 14:46:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:46:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:46:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:09 UTC)" (scheduled at 2021-11-08 14:46:09.376681+00:00) notificationworker stdout | 2021-11-08 14:46:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:46:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:20 UTC)" (scheduled at 2021-11-08 14:46:10.322052+00:00) notificationworker stdout | 2021-11-08 14:46:10,707 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:20 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:46:14,549 [237] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:46:14 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) gunicorn-registry stdout | 2021-11-08 14:46:14,551 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:46:14 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 14:46:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:16 UTC)" (scheduled at 2021-11-08 14:46:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:46:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:46:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:47 UTC)" (scheduled at 2021-11-08 14:46:17.787050+00:00) notificationworker stdout | 2021-11-08 14:46:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:30 UTC)" (scheduled at 2021-11-08 14:46:20.322052+00:00) notificationworker stdout | 2021-11-08 14:46:21,010 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:46:21,019 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 289-329 securityworker stdout | 2021-11-08 14:46:21,022 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 14:46:21,025 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 14:46:21,028 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 23-63 securityworker stdout | 2021-11-08 14:46:21,030 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 14:46:21,032 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:46:21,035 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:46:21,037 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 14:46:21,040 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 14:46:21,042 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 14:46:21,044 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:46:21,046 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:46:21,050 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 14:46:21,052 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 14:46:21,054 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:46:21,056 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 14:46:21,057 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:46:21,060 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 260-300 securityworker stdout | 2021-11-08 14:46:21,062 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 33-73 securityworker stdout | 2021-11-08 14:46:21,065 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 186-226 securityworker stdout | 2021-11-08 14:46:21,068 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 14:46:21,071 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 14:46:21,073 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:46:21,075 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 14:46:21,078 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 14:46:21,081 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 14:46:21,084 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 14:46:21,086 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 14:46:21,088 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:46:21,091 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 14:46:21,093 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 14:46:21,097 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 14:46:21,100 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 300-340 securityworker stdout | 2021-11-08 14:46:21,104 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 14:46:21,104 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:46:21,113 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block buildlogsarchiver stdout | 2021-11-08 14:46:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:51 UTC)" (scheduled at 2021-11-08 14:46:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:46:21,811 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:46:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:52 UTC)" (scheduled at 2021-11-08 14:46:22.617060+00:00) gcworker stdout | 2021-11-08 14:46:22,675 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:46:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:27 UTC)" (scheduled at 2021-11-08 14:46:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:46:28,217 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:46:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:40 UTC)" (scheduled at 2021-11-08 14:46:30.322052+00:00) notificationworker stdout | 2021-11-08 14:46:33,184 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:46:37,181 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:46:37,181 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:46:37,182 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:46:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:46:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:50 UTC)" (scheduled at 2021-11-08 14:46:40.322052+00:00) notificationworker stdout | 2021-11-08 14:46:40,357 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:46:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:46:47 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.028 1689 0.027) gunicorn-registry stdout | 2021-11-08 14:46:47,231 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:46:47 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:46:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:17 UTC)" (scheduled at 2021-11-08 14:46:47.787050+00:00) securityworker stdout | 2021-11-08 14:46:48,116 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 14:46:48,119 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 14:46:48,122 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:46:48,124 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 14:46:48,127 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 14:46:48,130 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:46:48,133 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 14:46:48,136 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:46:48,140 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:46:48,143 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 14:46:48,146 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 14:46:48,148 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 14:46:48,151 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 14:46:48,153 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 443-464 securityworker stdout | 2021-11-08 14:46:48,155 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 14:46:48,156 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:46:48,158 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 14:46:48,161 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 14:46:48,166 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:46:48,168 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:46:48,171 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:46:48,173 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 14:46:48,175 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 14:46:48,178 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 14:46:48,180 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 14:46:48,183 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 14:46:48,185 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 14:46:48,187 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 14:46:48,189 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 14:46:48,192 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:46:48,195 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 14:46:48,197 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 14:46:48,199 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:46:48,202 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 14:46:48,204 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 14:46:48,204 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:46:48,220 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 14:46:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:00 UTC)" (scheduled at 2021-11-08 14:46:50.322052+00:00) notificationworker stdout | 2021-11-08 14:46:50,363 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:46:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:50 UTC)" (scheduled at 2021-11-08 14:46:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:46:50,429 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:46:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:21 UTC)" (scheduled at 2021-11-08 14:46:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:46:51,824 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:46:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:22 UTC)" (scheduled at 2021-11-08 14:46:52.617060+00:00) gcworker stdout | 2021-11-08 14:46:52,668 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:46:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:54 UTC)" (scheduled at 2021-11-08 14:46:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:46:55,038 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:46:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:55 UTC)" (scheduled at 2021-11-08 14:46:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:46:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:47:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:46:57 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.015) gunicorn-registry stdout | 2021-11-08 14:46:57,738 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:46:57 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:47:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:10 UTC)" (scheduled at 2021-11-08 14:47:00.322052+00:00) notificationworker stdout | 2021-11-08 14:47:00,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:10 UTC)" executed successfully securityworker stdout | 2021-11-08 14:47:02,018 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:47:02,019 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:47:02,019 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:17 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:47:05 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.343 1690 0.342) gunicorn-registry stdout | 2021-11-08 14:47:05,021 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:47:05 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 14:47:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:06 UTC)" (scheduled at 2021-11-08 14:47:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:47:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:47:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:09 UTC)" (scheduled at 2021-11-08 14:47:09.376681+00:00) notificationworker stdout | 2021-11-08 14:47:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:47:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:20 UTC)" (scheduled at 2021-11-08 14:47:10.322052+00:00) notificationworker stdout | 2021-11-08 14:47:10,502 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:47:10 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.015) gunicorn-registry stdout | 2021-11-08 14:47:10,657 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:47:10 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 14:47:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:16 UTC)" (scheduled at 2021-11-08 14:47:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:47:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:47:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:47 UTC)" (scheduled at 2021-11-08 14:47:17.787050+00:00) notificationworker stdout | 2021-11-08 14:47:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:30 UTC)" (scheduled at 2021-11-08 14:47:20.322052+00:00) notificationworker stdout | 2021-11-08 14:47:20,595 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:47:20,606 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:47:20,609 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 14:47:20,612 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 14:47:20,615 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 289-329 securityworker stdout | 2021-11-08 14:47:20,617 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 14:47:20,621 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:47:20 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.528 468 1.527) gunicorn-web stdout | 2021-11-08 14:47:20,623 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:47:20 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:47:20,625 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 14:47:20,628 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 14:47:20,630 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 14:47:20,632 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 14:47:20,634 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:47:20,636 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 14:47:20,640 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:47:20,643 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 14:47:20,645 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:47:20,647 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 14:47:20,648 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 444-464 securityworker stdout | 2021-11-08 14:47:20,649 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:47:20,651 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 14:47:20,653 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:47:20,655 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 14:47:20,656 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 14:47:20,658 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 14:47:20,660 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:47:20,662 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:47:20,664 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 14:47:20,666 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:47:20,669 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:47:20,671 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 14:47:20,673 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 250-290 securityworker stdout | 2021-11-08 14:47:20,674 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 14:47:20,676 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 14:47:20,678 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:47:20,680 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 14:47:20,682 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 14:47:20,682 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:47:20,690 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block buildlogsarchiver stdout | 2021-11-08 14:47:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:51 UTC)" (scheduled at 2021-11-08 14:47:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:47:22,157 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:47:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:52 UTC)" (scheduled at 2021-11-08 14:47:22.617060+00:00) gcworker stdout | 2021-11-08 14:47:22,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:52 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:47:24,470 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:47:24 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:47:24 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:47:27 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1691 0.014) gunicorn-registry stdout | 2021-11-08 14:47:27,070 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:47:27 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:47:27,122 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:47:27,122 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:47:27,123 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:47:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:47:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:27 UTC)" (scheduled at 2021-11-08 14:47:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:47:28,542 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:47:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:40 UTC)" (scheduled at 2021-11-08 14:47:30.322052+00:00) notificationworker stdout | 2021-11-08 14:47:30,427 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:47:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:50 UTC)" (scheduled at 2021-11-08 14:47:40.322052+00:00) notificationworker stdout | 2021-11-08 14:47:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:47:50 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:47:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:52:46 UTC)" (scheduled at 2021-11-08 14:47:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:47:46,150 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:52:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:47:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:17 UTC)" (scheduled at 2021-11-08 14:47:47.787050+00:00) securityworker stdout | 2021-11-08 14:47:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 14:47:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 14:47:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 14:47:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 14:47:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 14:47:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:47:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 26-66 securityworker stdout | 2021-11-08 14:47:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:47:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 14:47:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:47:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 14:47:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:47:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 14:47:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 14:47:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 14:47:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 14:47:47,866 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:47:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 294-334 securityworker stdout | 2021-11-08 14:47:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 14:47:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:47:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 14:47:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 14:47:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 173-213 securityworker stdout | 2021-11-08 14:47:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 14:47:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:47:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 29-69 securityworker stdout | 2021-11-08 14:47:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:47:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 334-374 securityworker stdout | 2021-11-08 14:47:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 14:47:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:47:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:47:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 158-198 securityworker stdout | 2021-11-08 14:47:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:47:47,900 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:47:47,945 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:47:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:00 UTC)" (scheduled at 2021-11-08 14:47:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:47:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:50 UTC)" (scheduled at 2021-11-08 14:47:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:47:50,412 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:47:50,540 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:47:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:21 UTC)" (scheduled at 2021-11-08 14:47:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:47:51,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:47:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:52:52 UTC)" (scheduled at 2021-11-08 14:47:52.376404+00:00) gcworker stdout | 2021-11-08 14:47:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:22 UTC)" (scheduled at 2021-11-08 14:47:52.617060+00:00) notificationworker stdout | 2021-11-08 14:47:52,631 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:52:52 UTC)" executed successfully gcworker stdout | 2021-11-08 14:47:52,643 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:47:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:54 UTC)" (scheduled at 2021-11-08 14:47:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:47:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:47:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:55 UTC)" (scheduled at 2021-11-08 14:47:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:47:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:48:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:47:56 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1690 0.016) gunicorn-registry stdout | 2021-11-08 14:47:56,300 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:47:56 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:48:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:10 UTC)" (scheduled at 2021-11-08 14:48:00.322052+00:00) notificationworker stdout | 2021-11-08 14:48:00,344 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:48:03 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.239 1690 0.239) gunicorn-registry stdout | 2021-11-08 14:48:03,790 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:48:03 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 14:48:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:06 UTC)" (scheduled at 2021-11-08 14:48:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:48:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:48:06 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:48:06,480 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:48:06 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:48:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:09 UTC)" (scheduled at 2021-11-08 14:48:09.376681+00:00) notificationworker stdout | 2021-11-08 14:48:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:48:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:20 UTC)" (scheduled at 2021-11-08 14:48:10.322052+00:00) notificationworker stdout | 2021-11-08 14:48:10,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:48:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:53:14 UTC)" (scheduled at 2021-11-08 14:48:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:48:15,434 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:53:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:48:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:16 UTC)" (scheduled at 2021-11-08 14:48:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:48:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:48:17,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:17 UTC)" skipped: maximum number of running instances reached (1) notificationworker stdout | 2021-11-08 14:48:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:30 UTC)" (scheduled at 2021-11-08 14:48:20.322052+00:00) notificationworker stdout | 2021-11-08 14:48:20,404 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:48:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:51 UTC)" (scheduled at 2021-11-08 14:48:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:48:21,856 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:51 UTC)" executed successfully securityworker stdout | 2021-11-08 14:48:22,022 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:48:22,022 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:48:22,023 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:47 UTC)" executed successfully gcworker stdout | 2021-11-08 14:48:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:52 UTC)" (scheduled at 2021-11-08 14:48:22.617060+00:00) gcworker stdout | 2021-11-08 14:48:22,794 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:48:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:48:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:27 UTC)" (scheduled at 2021-11-08 14:48:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:48:28,374 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:48:30,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:40 UTC)" (scheduled at 2021-11-08 14:48:30.322052+00:00) notificationworker stdout | 2021-11-08 14:48:30,355 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:48:32 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:48:32,496 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:48:32 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:48:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:50 UTC)" (scheduled at 2021-11-08 14:48:40.322052+00:00) notificationworker stdout | 2021-11-08 14:48:40,719 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:48:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:48:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:17 UTC)" (scheduled at 2021-11-08 14:48:47.787050+00:00) securityworker stdout | 2021-11-08 14:48:48,001 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 14:48:48,004 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 14:48:48,006 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:48:48,008 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:48:48,010 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 14:48:48,012 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 29-69 securityworker stdout | 2021-11-08 14:48:48,014 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:48:48,016 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 179-219 securityworker stdout | 2021-11-08 14:48:48,018 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 14:48:48,020 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:48:48,022 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:48:48,025 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 219-259 securityworker stdout | 2021-11-08 14:48:48,168 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 14:48:48,174 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 428-464 securityworker stdout | 2021-11-08 14:48:48,179 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 14:48:48,181 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 14:48:48,183 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 14:48:48,183 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:48:48,509 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 380-420 securityworker stdout | 2021-11-08 14:48:48,512 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:48:48,514 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 14:48:48,516 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 14:48:48,518 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:48:48,520 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:48:48,522 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 173-213 securityworker stdout | 2021-11-08 14:48:48,525 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 14:48:48,527 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 289-329 securityworker stdout | 2021-11-08 14:48:48,529 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 14:48:48,530 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 14:48:48,532 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 14:48:48,534 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 14:48:48,536 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 14:48:48,538 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 14:48:48,540 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 334-374 securityworker stdout | 2021-11-08 14:48:48,542 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:48:48,544 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 14:48:48,546 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:48:48,546 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:48:48,553 [102] [INFO] [util.migrate.allocator] Found 24 candidates, processing block notificationworker stdout | 2021-11-08 14:48:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:00 UTC)" (scheduled at 2021-11-08 14:48:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:48:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:50 UTC)" (scheduled at 2021-11-08 14:48:50.393684+00:00) notificationworker stdout | 2021-11-08 14:48:50,438 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:48:50,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:48:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:21 UTC)" (scheduled at 2021-11-08 14:48:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:48:51,823 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:48:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:22 UTC)" (scheduled at 2021-11-08 14:48:52.617060+00:00) gcworker stdout | 2021-11-08 14:48:53,975 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:48:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:54 UTC)" (scheduled at 2021-11-08 14:48:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:48:54,343 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:48:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:55 UTC)" (scheduled at 2021-11-08 14:48:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:48:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:49:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:49:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:10 UTC)" (scheduled at 2021-11-08 14:49:00.322052+00:00) notificationworker stdout | 2021-11-08 14:49:00,768 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:10 UTC)" executed successfully securityworker stdout | 2021-11-08 14:49:01,402 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:49:01,402 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:49:01,403 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:17 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:49:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:06 UTC)" (scheduled at 2021-11-08 14:49:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:49:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:49:09,382 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:09 UTC)" (scheduled at 2021-11-08 14:49:09.376681+00:00) notificationworker stdout | 2021-11-08 14:49:09,382 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:49:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:20 UTC)" (scheduled at 2021-11-08 14:49:10.322052+00:00) notificationworker stdout | 2021-11-08 14:49:10,458 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:49:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:16 UTC)" (scheduled at 2021-11-08 14:49:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:49:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:49:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:47 UTC)" (scheduled at 2021-11-08 14:49:17.787050+00:00) securityworker stdout | 2021-11-08 14:49:18,270 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 14:49:18,272 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 454-464 securityworker stdout | 2021-11-08 14:49:18,274 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 14:49:18,275 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:49:18,278 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 14:49:18,280 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 14:49:18,282 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 14:49:18,283 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 14:49:18,285 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:49:18,287 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 14:49:18,289 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 14:49:18,291 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 14:49:18,407 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 14:49:18,411 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:49:18,413 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:49:18,416 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 14:49:18,418 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 14:49:18,422 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 14:49:18,422 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:49:18,652 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:49:18,655 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 14:49:18,658 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 14:49:18,661 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 14:49:18,664 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 14:49:18,667 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 14:49:18,670 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 14:49:18,672 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 14:49:18,674 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 14:49:18,676 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 14:49:18,679 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 14:49:18,681 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 14:49:18,683 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:49:18,685 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:49:18,687 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:49:18,689 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:49:18,690 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:49:19,227 [102] [INFO] [util.migrate.allocator] Found 31 candidates, processing block notificationworker stdout | 2021-11-08 14:49:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:30 UTC)" (scheduled at 2021-11-08 14:49:20.322052+00:00) notificationworker stdout | 2021-11-08 14:49:20,892 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:49:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:51 UTC)" (scheduled at 2021-11-08 14:49:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:49:21,912 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:49:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:52 UTC)" (scheduled at 2021-11-08 14:49:22.617060+00:00) gcworker stdout | 2021-11-08 14:49:22,839 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:49:27,886 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:27 UTC)" (scheduled at 2021-11-08 14:49:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:49:27,987 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:27 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:49:29 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.449 458 1.449) gunicorn-web stdout | 2021-11-08 14:49:29,010 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:49:29 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:49:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:40 UTC)" (scheduled at 2021-11-08 14:49:30.322052+00:00) notificationworker stdout | 2021-11-08 14:49:30,348 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:49:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:50 UTC)" (scheduled at 2021-11-08 14:49:40.322052+00:00) notificationworker stdout | 2021-11-08 14:49:40,374 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:49:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:49:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:49:42,958 [234] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:49:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:49:47,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:49:47 UTC)" skipped: maximum number of running instances reached (1) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:49:49 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:49:49,616 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:49:49 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:49:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:00 UTC)" (scheduled at 2021-11-08 14:49:50.322052+00:00) notificationworker stdout | 2021-11-08 14:49:50,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:00 UTC)" executed successfully securityworker stdout | 2021-11-08 14:49:50,373 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:49:50,373 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:49:50,374 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:17 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:49:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:50 UTC)" (scheduled at 2021-11-08 14:49:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:49:50,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:49:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:21 UTC)" (scheduled at 2021-11-08 14:49:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:49:52,059 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:49:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:22 UTC)" (scheduled at 2021-11-08 14:49:52.617060+00:00) gcworker stdout | 2021-11-08 14:49:52,890 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:49:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:54 UTC)" (scheduled at 2021-11-08 14:49:54.169080+00:00) namespacegcworker stdout | 2021-11-08 14:49:55,133 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:55 UTC)" (scheduled at 2021-11-08 14:49:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:49:55,133 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:55 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:49:55,245 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:50:54 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:49:55 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.078 47 0.078) gunicorn-web stdout | 2021-11-08 14:49:55,764 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:49:55 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:49:55 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.082 383 0.082) gunicorn-web stdout | 2021-11-08 14:49:55,769 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:49:55 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:50:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:10 UTC)" (scheduled at 2021-11-08 14:50:00.322052+00:00) notificationworker stdout | 2021-11-08 14:50:00,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:50:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:06 UTC)" (scheduled at 2021-11-08 14:50:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:50:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:50:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:09 UTC)" (scheduled at 2021-11-08 14:50:09.376681+00:00) notificationworker stdout | 2021-11-08 14:50:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:50:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:20 UTC)" (scheduled at 2021-11-08 14:50:10.322052+00:00) notificationworker stdout | 2021-11-08 14:50:10,401 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:50:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:16 UTC)" (scheduled at 2021-11-08 14:50:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:50:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:50:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:47 UTC)" (scheduled at 2021-11-08 14:50:17.787050+00:00) securityworker stdout | 2021-11-08 14:50:18,216 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:50:18,243 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 14:50:18,246 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 14:50:18,250 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 14:50:18,253 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:50:18,256 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 14:50:18,259 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 14:50:18,262 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 14:50:18,265 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:50:18,268 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 14:50:18,271 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 14:50:18,274 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 14:50:18,277 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:50:18,279 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:50:18,282 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 14:50:18,284 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 460-464 securityworker stdout | 2021-11-08 14:50:18,286 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 14:50:18,287 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:50:18,289 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 133-173 securityworker stdout | 2021-11-08 14:50:18,291 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 14:50:18,293 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 14:50:18,295 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:50:18,298 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 14:50:18,301 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 372-412 securityworker stdout | 2021-11-08 14:50:18,304 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 14:50:18,307 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 14:50:18,309 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:50:18,312 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 268-308 securityworker stdout | 2021-11-08 14:50:18,314 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 320-360 securityworker stdout | 2021-11-08 14:50:18,317 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 14:50:18,320 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:50:18,323 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 173-213 securityworker stdout | 2021-11-08 14:50:18,326 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:50:18,329 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 14:50:18,332 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 14:50:18,336 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 14:50:18,339 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 14:50:18,339 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:50:18,600 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:50:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:30 UTC)" (scheduled at 2021-11-08 14:50:20.322052+00:00) notificationworker stdout | 2021-11-08 14:50:20,372 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:50:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:51 UTC)" (scheduled at 2021-11-08 14:50:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:50:21,904 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:51 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:50:22 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.003) gunicorn-registry stdout | 2021-11-08 14:50:22,300 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:50:22 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gcworker stdout | 2021-11-08 14:50:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:52 UTC)" (scheduled at 2021-11-08 14:50:22.617060+00:00) gcworker stdout | 2021-11-08 14:50:22,726 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:52 UTC)" executed successfully securityworker stdout | 2021-11-08 14:50:23,374 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:50:23,375 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:50:23,376 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:50:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:50:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:27 UTC)" (scheduled at 2021-11-08 14:50:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:50:28,094 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:50:30,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:40 UTC)" (scheduled at 2021-11-08 14:50:30.322052+00:00) notificationworker stdout | 2021-11-08 14:50:30,581 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:50:33 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:50:33,499 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:50:33 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:50:40,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:50 UTC)" (scheduled at 2021-11-08 14:50:40.322052+00:00) notificationworker stdout | 2021-11-08 14:50:40,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:50:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:50:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:17 UTC)" (scheduled at 2021-11-08 14:50:47.787050+00:00) securityworker stdout | 2021-11-08 14:50:48,663 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:50:48,667 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 14:50:48,670 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 199-239 securityworker stdout | 2021-11-08 14:50:48,673 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 14:50:48,676 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:50:48,678 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:50:48,681 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 14:50:48,685 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 14:50:48,688 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 14:50:48,691 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 14:50:48,695 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:50:48,698 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 18-58 securityworker stdout | 2021-11-08 14:50:48,701 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 14:50:48,704 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 14:50:48,706 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 14:50:48,709 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:50:48,711 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 14:50:48,713 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 14:50:48,713 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:50:48,716 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 27-67 securityworker stdout | 2021-11-08 14:50:48,719 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 360-400 securityworker stdout | 2021-11-08 14:50:48,721 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 14:50:48,723 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:50:48,726 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:50:48,729 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:50:48,735 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 14:50:48,738 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 14:50:48,741 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 14:50:48,744 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:50:48,747 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 14:50:48,749 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:50:48,752 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:50:48,754 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:50:48,757 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 447-464 securityworker stdout | 2021-11-08 14:50:48,760 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 14:50:48,762 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:50:48,762 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:50:48,771 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 14:50:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:55:49 UTC)" (scheduled at 2021-11-08 14:50:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 14:50:49,459 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:55:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:50:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:00 UTC)" (scheduled at 2021-11-08 14:50:50.322052+00:00) notificationworker stdout | 2021-11-08 14:50:50,343 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:50:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:50 UTC)" (scheduled at 2021-11-08 14:50:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:50:50,411 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:50:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:21 UTC)" (scheduled at 2021-11-08 14:50:51.793811+00:00) gcworker stdout | 2021-11-08 14:50:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:22 UTC)" (scheduled at 2021-11-08 14:50:52.617060+00:00) gcworker stdout | 2021-11-08 14:50:53,342 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:22 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:50:53,346 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:21 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:50:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:54 UTC)" (scheduled at 2021-11-08 14:50:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:50:54,508 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:54 UTC)" executed successfully securityworker stdout | 2021-11-08 14:50:54,634 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:50:54,634 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:50:54,635 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:17 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:50:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:55 UTC)" (scheduled at 2021-11-08 14:50:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:50:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:51:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:51:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:10 UTC)" (scheduled at 2021-11-08 14:51:00.322052+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:51:01 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:51:01,494 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:51:01 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:51:01,761 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:51:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:06 UTC)" (scheduled at 2021-11-08 14:51:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:51:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:51:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:09 UTC)" (scheduled at 2021-11-08 14:51:09.376681+00:00) notificationworker stdout | 2021-11-08 14:51:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:51:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:20 UTC)" (scheduled at 2021-11-08 14:51:10.322052+00:00) notificationworker stdout | 2021-11-08 14:51:10,346 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:51:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:16 UTC)" (scheduled at 2021-11-08 14:51:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:51:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:51:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:47 UTC)" (scheduled at 2021-11-08 14:51:17.787050+00:00) securityworker stdout | 2021-11-08 14:51:17,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 14:51:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 14:51:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 14:51:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:51:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:51:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:51:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 14:51:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 14:51:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 14:51:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 14:51:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 14:51:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 14:51:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 14:51:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 14:51:17,838 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:51:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 309-349 securityworker stdout | 2021-11-08 14:51:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 14:51:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 14:51:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 14:51:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:51:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 14:51:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 28-68 securityworker stdout | 2021-11-08 14:51:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:51:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:51:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 securityworker stdout | 2021-11-08 14:51:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 14:51:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 14:51:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 14:51:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 68-108 securityworker stdout | 2021-11-08 14:51:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 14:51:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 14:51:17,892 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:51:17,903 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:51:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:30 UTC)" (scheduled at 2021-11-08 14:51:20.322052+00:00) notificationworker stdout | 2021-11-08 14:51:20,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:51:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:51 UTC)" (scheduled at 2021-11-08 14:51:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:51:22,179 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:51:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:52 UTC)" (scheduled at 2021-11-08 14:51:22.617060+00:00) gcworker stdout | 2021-11-08 14:51:22,637 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:51:24 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:51:24,378 [234] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:51:24 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:51:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:27 UTC)" (scheduled at 2021-11-08 14:51:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:51:27,911 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:27 UTC)" executed successfully securityworker stdout | 2021-11-08 14:51:28,147 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:51:28,147 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:51:28,148 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:51:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:51:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:40 UTC)" (scheduled at 2021-11-08 14:51:30.322052+00:00) notificationworker stdout | 2021-11-08 14:51:30,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:51:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:50 UTC)" (scheduled at 2021-11-08 14:51:40.322052+00:00) notificationworker stdout | 2021-11-08 14:51:40,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:51:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:51:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:17 UTC)" (scheduled at 2021-11-08 14:51:47.787050+00:00) securityworker stdout | 2021-11-08 14:51:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:51:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 12-52 securityworker stdout | 2021-11-08 14:51:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 14:51:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 14:51:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:51:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 52-92 securityworker stdout | 2021-11-08 14:51:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 14:51:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 14:51:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 14:51:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:51:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 14:51:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 14:51:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 14:51:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:51:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 14:51:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 14:51:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 14:51:47,848 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:51:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 14:51:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 14:51:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 14:51:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:51:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:51:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 237-277 securityworker stdout | 2021-11-08 14:51:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 14:51:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:51:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:51:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 10-50 securityworker stdout | 2021-11-08 14:51:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 14:51:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 14:51:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:51:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:51:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 391-431 securityworker stdout | 2021-11-08 14:51:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 444-464 securityworker stdout | 2021-11-08 14:51:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 14:51:47,886 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:51:48,123 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:51:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:00 UTC)" (scheduled at 2021-11-08 14:51:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:51:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:50 UTC)" (scheduled at 2021-11-08 14:51:50.393684+00:00) notificationworker stdout | 2021-11-08 14:51:50,457 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:51:50,458 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:51:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:21 UTC)" (scheduled at 2021-11-08 14:51:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:51:52,071 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:51:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:22 UTC)" (scheduled at 2021-11-08 14:51:52.617060+00:00) gcworker stdout | 2021-11-08 14:51:53,038 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:51:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:54 UTC)" (scheduled at 2021-11-08 14:51:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:51:54,406 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:51:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:55 UTC)" (scheduled at 2021-11-08 14:51:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:51:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:52:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:51:57 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.255 325 0.255) gunicorn-registry stdout | 2021-11-08 14:51:57,997 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:51:57 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:52:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:10 UTC)" (scheduled at 2021-11-08 14:52:00.322052+00:00) notificationworker stdout | 2021-11-08 14:52:00,360 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:10 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:52:04,964 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:52:04 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:52:04 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.451 325 0.450) exportactionlogsworker stdout | 2021-11-08 14:52:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:06 UTC)" (scheduled at 2021-11-08 14:52:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:52:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:52:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:09 UTC)" (scheduled at 2021-11-08 14:52:09.376681+00:00) notificationworker stdout | 2021-11-08 14:52:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:52:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:20 UTC)" (scheduled at 2021-11-08 14:52:10.322052+00:00) notificationworker stdout | 2021-11-08 14:52:10,468 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:52:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:16 UTC)" (scheduled at 2021-11-08 14:52:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:52:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:52:17,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:17 UTC)" skipped: maximum number of running instances reached (1) notificationworker stdout | 2021-11-08 14:52:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:30 UTC)" (scheduled at 2021-11-08 14:52:20.322052+00:00) notificationworker stdout | 2021-11-08 14:52:21,089 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:30 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:52:21,108 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:52:21 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:52:21 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.989 325 0.988) buildlogsarchiver stdout | 2021-11-08 14:52:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:51 UTC)" (scheduled at 2021-11-08 14:52:21.793811+00:00) nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:52:21 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.187 325 0.187) gunicorn-registry stdout | 2021-11-08 14:52:21,822 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:52:21 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" buildlogsarchiver stdout | 2021-11-08 14:52:21,825 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:52:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:52 UTC)" (scheduled at 2021-11-08 14:52:22.617060+00:00) gcworker stdout | 2021-11-08 14:52:23,242 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:52:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:27 UTC)" (scheduled at 2021-11-08 14:52:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:52:27,907 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:52:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:40 UTC)" (scheduled at 2021-11-08 14:52:30.322052+00:00) notificationworker stdout | 2021-11-08 14:52:30,529 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:52:32 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.228 325 0.228) gunicorn-registry stdout | 2021-11-08 14:52:32,782 [234] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:52:32 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 14:52:33,490 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:52:33,491 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:52:33,492 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:52:47 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:52:39,052 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:52:39 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:52:39 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.110 325 0.110) notificationworker stdout | 2021-11-08 14:52:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:50 UTC)" (scheduled at 2021-11-08 14:52:40.322052+00:00) notificationworker stdout | 2021-11-08 14:52:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:52:50 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:52:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:57:46 UTC)" (scheduled at 2021-11-08 14:52:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:52:46,180 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:57:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:52:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:17 UTC)" (scheduled at 2021-11-08 14:52:47.787050+00:00) securityworker stdout | 2021-11-08 14:52:48,728 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 14:52:48,731 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 24-64 securityworker stdout | 2021-11-08 14:52:48,734 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 14:52:48,737 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 14:52:48,740 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 14:52:48,742 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 14:52:48,745 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 14:52:48,749 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 14:52:48,752 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 14:52:48,755 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 14:52:48,758 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 14:52:48,762 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 14:52:48,765 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:52:48,768 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 14:52:48,772 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 14:52:48,775 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 14:52:48,777 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 453-464 securityworker stdout | 2021-11-08 14:52:48,777 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:52:48,781 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 32-72 securityworker stdout | 2021-11-08 14:52:48,784 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:52:48,787 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:52:48,789 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 14:52:48,793 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 14:52:48,796 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:52:48,806 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 272-312 securityworker stdout | 2021-11-08 14:52:48,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:52:48,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 14:52:48,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 14:52:48,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 14:52:48,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 312-352 securityworker stdout | 2021-11-08 14:52:48,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:52:48,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 14:52:48,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:52:48,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:52:48,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:52:48,837 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:52:48,849 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:52:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:00 UTC)" (scheduled at 2021-11-08 14:52:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:52:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:50 UTC)" (scheduled at 2021-11-08 14:52:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:52:50,618 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:52:50,622 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:52:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:21 UTC)" (scheduled at 2021-11-08 14:52:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:52:51,971 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:21 UTC)" executed successfully securityworker stdout | 2021-11-08 14:52:52,118 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:52:52,119 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:52:52,119 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:52:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:57:52 UTC)" (scheduled at 2021-11-08 14:52:52.376404+00:00) gcworker stdout | 2021-11-08 14:52:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:22 UTC)" (scheduled at 2021-11-08 14:52:52.617060+00:00) notificationworker stdout | 2021-11-08 14:52:52,618 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:57:52 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:52:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:54 UTC)" (scheduled at 2021-11-08 14:52:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:52:54,181 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:52:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:55 UTC)" (scheduled at 2021-11-08 14:52:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:52:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:53:55 UTC)" executed successfully gcworker stdout | 2021-11-08 14:52:56,413 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:22 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:53:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:10 UTC)" (scheduled at 2021-11-08 14:53:00.322052+00:00) notificationworker stdout | 2021-11-08 14:53:01,468 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:53:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:06 UTC)" (scheduled at 2021-11-08 14:53:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:53:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:53:08 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.396 325 0.396) gunicorn-registry stdout | 2021-11-08 14:53:08,029 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:53:08 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:53:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:09 UTC)" (scheduled at 2021-11-08 14:53:09.376681+00:00) notificationworker stdout | 2021-11-08 14:53:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:53:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:20 UTC)" (scheduled at 2021-11-08 14:53:10.322052+00:00) notificationworker stdout | 2021-11-08 14:53:10,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:20 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:53:10,607 [237] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:53:10 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:53:10 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.090 325 0.090) gunicorn-registry stdout | 2021-11-08 14:53:11,426 [237] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} gunicorn-registry stdout | 2021-11-08 14:53:11,427 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:53:11 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:53:11 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) repositorygcworker stdout | 2021-11-08 14:53:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:58:14 UTC)" (scheduled at 2021-11-08 14:53:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:53:15,074 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 14:58:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:53:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:16 UTC)" (scheduled at 2021-11-08 14:53:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:53:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:53:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:47 UTC)" (scheduled at 2021-11-08 14:53:17.787050+00:00) gunicorn-registry stdout | 2021-11-08 14:53:19,536 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:53:19 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:53:19 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (4.013 1692 4.013) securityworker stdout | 2021-11-08 14:53:19,934 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 14:53:19,937 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 146-186 securityworker stdout | 2021-11-08 14:53:19,941 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:53:19,949 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 14:53:19,954 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:53:19,964 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 14:53:19,970 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 14:53:19,974 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:53:19,979 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 14:53:19,983 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 186-226 securityworker stdout | 2021-11-08 14:53:19,985 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 14:53:19,988 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 14:53:19,991 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 14:53:19,998 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:53:20,014 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:53:20,259 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 14:53:20,263 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 14:53:20,267 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 14:53:20,271 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 14:53:20,275 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 14:53:20,275 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:53:20,280 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 14:53:20,284 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 14:53:20,287 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:53:20,289 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:53:20,291 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:53:20,294 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:53:20,301 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:53:20,304 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 14:53:20,307 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 14:53:20,315 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:53:20,318 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 14:53:20,321 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 notificationworker stdout | 2021-11-08 14:53:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:30 UTC)" (scheduled at 2021-11-08 14:53:20.322052+00:00) securityworker stdout | 2021-11-08 14:53:20,337 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 notificationworker stdout | 2021-11-08 14:53:20,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:30 UTC)" executed successfully securityworker stdout | 2021-11-08 14:53:20,340 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 14:53:20,346 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:53:20,349 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 14:53:20,369 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 14:53:20,378 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 14:53:20,381 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 288-328 securityworker stdout | 2021-11-08 14:53:20,381 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:53:20,391 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block buildlogsarchiver stdout | 2021-11-08 14:53:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:51 UTC)" (scheduled at 2021-11-08 14:53:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:53:21,824 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:53:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:52 UTC)" (scheduled at 2021-11-08 14:53:22.617060+00:00) gcworker stdout | 2021-11-08 14:53:22,872 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:52 UTC)" executed successfully securityworker stdout | 2021-11-08 14:53:23,845 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:53:23,845 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:53:23,846 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:53:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:53:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:27 UTC)" (scheduled at 2021-11-08 14:53:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:53:27,972 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:53:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:40 UTC)" (scheduled at 2021-11-08 14:53:30.322052+00:00) notificationworker stdout | 2021-11-08 14:53:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:53:33 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1690 0.017) gunicorn-registry stdout | 2021-11-08 14:53:33,821 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:53:33 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:53:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:50 UTC)" (scheduled at 2021-11-08 14:53:40.322052+00:00) notificationworker stdout | 2021-11-08 14:53:40,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:53:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:53:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:17 UTC)" (scheduled at 2021-11-08 14:53:47.787050+00:00) securityworker stdout | 2021-11-08 14:53:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 14:53:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:53:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:53:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 14:53:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 14:53:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 38-78 securityworker stdout | 2021-11-08 14:53:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 14:53:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 14:53:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:53:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 14:53:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 14:53:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:53:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 14:53:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 430-464 securityworker stdout | 2021-11-08 14:53:47,888 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:53:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:53:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:53:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 14:53:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:53:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:53:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:53:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 14:53:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 14:53:47,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 14:53:47,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 14:53:47,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:53:47,914 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 14:53:47,916 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 14:53:47,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 14:53:47,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:53:47,921 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:53:47,923 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 14:53:47,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:53:47,925 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:53:47,933 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:53:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:00 UTC)" (scheduled at 2021-11-08 14:53:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:53:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:50 UTC)" (scheduled at 2021-11-08 14:53:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:53:50,719 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:53:50,719 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:53:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:21 UTC)" (scheduled at 2021-11-08 14:53:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:53:51,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:53:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:22 UTC)" (scheduled at 2021-11-08 14:53:52.617060+00:00) gcworker stdout | 2021-11-08 14:53:52,646 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:53:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:54 UTC)" (scheduled at 2021-11-08 14:53:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:53:54,187 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:53:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:55 UTC)" (scheduled at 2021-11-08 14:53:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:53:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:54:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:54:00,053 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:54:00,054 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:54:00,055 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:54:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:10 UTC)" (scheduled at 2021-11-08 14:54:00.322052+00:00) notificationworker stdout | 2021-11-08 14:54:00,370 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:54:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:06 UTC)" (scheduled at 2021-11-08 14:54:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:54:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:54:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:09 UTC)" (scheduled at 2021-11-08 14:54:09.376681+00:00) notificationworker stdout | 2021-11-08 14:54:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:54:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:20 UTC)" (scheduled at 2021-11-08 14:54:10.322052+00:00) notificationworker stdout | 2021-11-08 14:54:10,348 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:54:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:16 UTC)" (scheduled at 2021-11-08 14:54:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:54:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:54:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:47 UTC)" (scheduled at 2021-11-08 14:54:17.787050+00:00) securityworker stdout | 2021-11-08 14:54:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 33-73 securityworker stdout | 2021-11-08 14:54:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:54:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:54:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 14:54:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 82-122 securityworker stdout | 2021-11-08 14:54:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 14:54:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 14:54:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:54:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 14:54:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 14:54:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 433-464 securityworker stdout | 2021-11-08 14:54:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 334-374 securityworker stdout | 2021-11-08 14:54:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 14:54:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 14:54:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:54:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 14:54:17,848 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:54:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 14:54:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 239-279 securityworker stdout | 2021-11-08 14:54:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 14:54:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:54:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 14:54:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 14:54:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 14:54:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 14:54:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 14:54:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 14:54:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 14:54:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 14:54:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 14:54:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:54:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 14:54:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 14:54:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 14:54:17,899 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:54:17,910 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 14:54:20,301 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:54:20,301 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:54:20,302 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:54:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:30 UTC)" (scheduled at 2021-11-08 14:54:20.322052+00:00) notificationworker stdout | 2021-11-08 14:54:20,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:30 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:54:20 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.057 896 0.056) gunicorn-web stdout | 2021-11-08 14:54:20,846 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:54:20 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" buildlogsarchiver stdout | 2021-11-08 14:54:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:51 UTC)" (scheduled at 2021-11-08 14:54:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:54:21,809 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:54:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:52 UTC)" (scheduled at 2021-11-08 14:54:22.617060+00:00) gcworker stdout | 2021-11-08 14:54:22,637 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:54:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:54:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:27 UTC)" (scheduled at 2021-11-08 14:54:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:54:28,123 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:54:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:40 UTC)" (scheduled at 2021-11-08 14:54:30.322052+00:00) notificationworker stdout | 2021-11-08 14:54:30,348 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:54:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:50 UTC)" (scheduled at 2021-11-08 14:54:40.322052+00:00) notificationworker stdout | 2021-11-08 14:54:40,395 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:54:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:54:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:17 UTC)" (scheduled at 2021-11-08 14:54:47.787050+00:00) notificationworker stdout | 2021-11-08 14:54:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:00 UTC)" (scheduled at 2021-11-08 14:54:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 14:54:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:50 UTC)" (scheduled at 2021-11-08 14:54:50.393684+00:00) notificationworker stdout | 2021-11-08 14:54:50,434 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:54:50,435 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:54:50,437 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 14:54:50,440 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 14:54:50,442 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 14:54:50,444 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 14:54:50,447 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 14:54:50,449 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 14:54:50,452 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 14:54:50,454 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 14:54:50,456 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:54:50,458 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 14:54:50,460 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:54:50,462 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:54:50,465 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 14:54:50,468 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 14:54:50,471 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:54:50,473 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 429-464 securityworker stdout | 2021-11-08 14:54:50,475 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:54:50,475 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:54:50,478 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:54:50,480 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 14:54:50,483 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 30-70 securityworker stdout | 2021-11-08 14:54:50,485 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 14:54:50,487 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:54:50,489 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:54:50,492 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 14:54:50,495 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 14:54:50,497 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:54:50,500 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 268-308 securityworker stdout | 2021-11-08 14:54:50,502 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 14:54:50,504 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 14:54:50,506 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:54:50,509 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:54:50,569 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:54:50,574 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 14:54:50,574 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:54:51,347 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block buildlogsarchiver stdout | 2021-11-08 14:54:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:21 UTC)" (scheduled at 2021-11-08 14:54:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:54:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:21 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:54:52 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.018 1689 0.018) gunicorn-registry stdout | 2021-11-08 14:54:52,263 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:54:52 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gcworker stdout | 2021-11-08 14:54:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:22 UTC)" (scheduled at 2021-11-08 14:54:52.617060+00:00) gcworker stdout | 2021-11-08 14:54:52,693 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:22 UTC)" executed successfully securityworker stdout | 2021-11-08 14:54:53,645 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:54:53,645 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:54:53,646 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:54:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:54 UTC)" (scheduled at 2021-11-08 14:54:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:54:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:54:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:55 UTC)" (scheduled at 2021-11-08 14:54:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:54:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:55:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:54:57 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.054 1690 0.025) gunicorn-registry stdout | 2021-11-08 14:54:57,325 [233] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:54:57 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:55:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:10 UTC)" (scheduled at 2021-11-08 14:55:00.322052+00:00) notificationworker stdout | 2021-11-08 14:55:00,356 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:55:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.046 47 0.046) gunicorn-web stdout | 2021-11-08 14:55:04,789 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:55:04 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:55:04 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.048 384 0.048) gunicorn-web stdout | 2021-11-08 14:55:04,791 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:55:04 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" exportactionlogsworker stdout | 2021-11-08 14:55:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:06 UTC)" (scheduled at 2021-11-08 14:55:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:55:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:55:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:09 UTC)" (scheduled at 2021-11-08 14:55:09.376681+00:00) notificationworker stdout | 2021-11-08 14:55:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:55:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:20 UTC)" (scheduled at 2021-11-08 14:55:10.322052+00:00) notificationworker stdout | 2021-11-08 14:55:10,362 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:55:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:16 UTC)" (scheduled at 2021-11-08 14:55:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:55:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:55:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:47 UTC)" (scheduled at 2021-11-08 14:55:17.787050+00:00) securityworker stdout | 2021-11-08 14:55:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 380-420 securityworker stdout | 2021-11-08 14:55:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 14:55:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:55:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 14:55:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:55:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:55:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 14:55:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 14:55:17,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:55:17,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 33-73 securityworker stdout | 2021-11-08 14:55:17,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:55:17,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:55:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:55:17,916 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 14:55:17,919 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:55:17,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 14:55:17,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:55:17,927 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 14:55:17,928 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:55:17,931 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:55:17,934 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 14:55:17,937 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:55:17,939 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:55:17,943 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 14:55:17,946 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 14:55:17,949 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:55:17,952 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 14:55:17,955 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:55:17,958 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 14:55:17,961 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 14:55:17,964 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 14:55:17,966 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:55:17,969 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 14:55:17,972 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 14:55:17,975 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 14:55:17,977 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 14:55:17,980 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 269-309 securityworker stdout | 2021-11-08 14:55:17,983 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:55:17,985 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:55:17,988 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 14:55:17,988 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:55:18,033 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:55:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:30 UTC)" (scheduled at 2021-11-08 14:55:20.322052+00:00) notificationworker stdout | 2021-11-08 14:55:20,349 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:55:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:51 UTC)" (scheduled at 2021-11-08 14:55:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:55:21,831 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:55:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:52 UTC)" (scheduled at 2021-11-08 14:55:22.617060+00:00) gcworker stdout | 2021-11-08 14:55:22,639 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:55:25 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.027 1690 0.027) gunicorn-registry stdout | 2021-11-08 14:55:25,562 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:55:25 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:55:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:27 UTC)" (scheduled at 2021-11-08 14:55:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:55:27,977 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:55:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:40 UTC)" (scheduled at 2021-11-08 14:55:30.322052+00:00) notificationworker stdout | 2021-11-08 14:55:30,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:55:30,612 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:55:30,612 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:55:30,613 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:55:47 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:55:38 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.015) gunicorn-registry stdout | 2021-11-08 14:55:38,022 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:55:38 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:55:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:50 UTC)" (scheduled at 2021-11-08 14:55:40.322052+00:00) notificationworker stdout | 2021-11-08 14:55:40,355 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:55:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:55:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:17 UTC)" (scheduled at 2021-11-08 14:55:47.787050+00:00) securityworker stdout | 2021-11-08 14:55:47,808 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 14:55:47,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:55:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:55:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:55:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 14:55:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 14:55:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 217-257 securityworker stdout | 2021-11-08 14:55:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 14:55:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 securityworker stdout | 2021-11-08 14:55:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 152-192 securityworker stdout | 2021-11-08 14:55:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 257-297 securityworker stdout | 2021-11-08 14:55:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 14:55:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 14:55:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 215-255 securityworker stdout | 2021-11-08 14:55:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 14:55:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:55:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 14:55:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 14:55:47,847 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:55:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:55:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 14:55:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 14:55:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:55:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 14:55:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 14:55:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:55:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 307-347 securityworker stdout | 2021-11-08 14:55:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 14:55:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 347-387 securityworker stdout | 2021-11-08 14:55:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 14:55:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 14:55:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 35-75 securityworker stdout | 2021-11-08 14:55:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 14:55:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 439-464 securityworker stdout | 2021-11-08 14:55:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:55:47,885 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:55:47,894 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 14:55:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:00:49 UTC)" (scheduled at 2021-11-08 14:55:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 14:55:49,456 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:00:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:55:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:00 UTC)" (scheduled at 2021-11-08 14:55:50.322052+00:00) notificationworker stdout | 2021-11-08 14:55:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:55:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:50 UTC)" (scheduled at 2021-11-08 14:55:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:55:50,425 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:55:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:21 UTC)" (scheduled at 2021-11-08 14:55:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:55:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:55:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:22 UTC)" (scheduled at 2021-11-08 14:55:52.617060+00:00) gcworker stdout | 2021-11-08 14:55:52,631 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:55:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:54 UTC)" (scheduled at 2021-11-08 14:55:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:55:54,190 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:55:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:55 UTC)" (scheduled at 2021-11-08 14:55:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:55:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:56:55 UTC)" executed successfully securityworker stdout | 2021-11-08 14:56:00,064 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:56:00,064 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:56:00,065 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:56:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:10 UTC)" (scheduled at 2021-11-08 14:56:00.322052+00:00) notificationworker stdout | 2021-11-08 14:56:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:56:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:06 UTC)" (scheduled at 2021-11-08 14:56:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:56:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:56:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:09 UTC)" (scheduled at 2021-11-08 14:56:09.376681+00:00) notificationworker stdout | 2021-11-08 14:56:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:09 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:56:09 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1690 0.014) gunicorn-registry stdout | 2021-11-08 14:56:09,744 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:56:09 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:56:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:20 UTC)" (scheduled at 2021-11-08 14:56:10.322052+00:00) notificationworker stdout | 2021-11-08 14:56:10,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:56:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:16 UTC)" (scheduled at 2021-11-08 14:56:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:56:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:56:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:47 UTC)" (scheduled at 2021-11-08 14:56:17.787050+00:00) securityworker stdout | 2021-11-08 14:56:17,809 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 93-133 securityworker stdout | 2021-11-08 14:56:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 25-65 securityworker stdout | 2021-11-08 14:56:17,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 14:56:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:56:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 14:56:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 14:56:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 14:56:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 14:56:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 14:56:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 133-173 securityworker stdout | 2021-11-08 14:56:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 360-400 securityworker stdout | 2021-11-08 14:56:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 14:56:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 14:56:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 14:56:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 14:56:17,837 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:56:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 14:56:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 14:56:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 26-66 securityworker stdout | 2021-11-08 14:56:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:56:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:56:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:56:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:56:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 14:56:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 14:56:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 14:56:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 14:56:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 309-349 securityworker stdout | 2021-11-08 14:56:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:56:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 14:56:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 14:56:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 14:56:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 14:56:17,870 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:56:17,877 [102] [INFO] [util.migrate.allocator] Found 24 candidates, processing block notificationworker stdout | 2021-11-08 14:56:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:30 UTC)" (scheduled at 2021-11-08 14:56:20.322052+00:00) notificationworker stdout | 2021-11-08 14:56:20,343 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:56:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:51 UTC)" (scheduled at 2021-11-08 14:56:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:56:21,912 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:56:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:52 UTC)" (scheduled at 2021-11-08 14:56:22.617060+00:00) gcworker stdout | 2021-11-08 14:56:22,639 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:56:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:27 UTC)" (scheduled at 2021-11-08 14:56:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:56:27,902 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:56:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:40 UTC)" (scheduled at 2021-11-08 14:56:30.322052+00:00) notificationworker stdout | 2021-11-08 14:56:30,349 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:56:30 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.062 404 0.062) gunicorn-web stdout | 2021-11-08 14:56:30,510 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:56:30 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:56:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:50 UTC)" (scheduled at 2021-11-08 14:56:40.322052+00:00) notificationworker stdout | 2021-11-08 14:56:40,347 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:56:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:56:47,098 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:56:47,098 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:56:47,099 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:56:47 UTC)" executed successfully securityworker stdout | 2021-11-08 14:56:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:17 UTC)" (scheduled at 2021-11-08 14:56:47.787050+00:00) securityworker stdout | 2021-11-08 14:56:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 21-61 securityworker stdout | 2021-11-08 14:56:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 353-393 securityworker stdout | 2021-11-08 14:56:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:56:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:56:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 14:56:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 14:56:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 14:56:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 14:56:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 14:56:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 14:56:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 14:56:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 14:56:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 14:56:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 14:56:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 269-309 securityworker stdout | 2021-11-08 14:56:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 14:56:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 444-464 securityworker stdout | 2021-11-08 14:56:47,850 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:56:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:56:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 14:56:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 14:56:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 14:56:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 14:56:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 14:56:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:56:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 14:56:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 14:56:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 14:56:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:56:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:56:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:56:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 14:56:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 14:56:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:56:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 14:56:47,885 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:56:47,890 [102] [INFO] [util.migrate.allocator] Found 19 candidates, processing block notificationworker stdout | 2021-11-08 14:56:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:00 UTC)" (scheduled at 2021-11-08 14:56:50.322052+00:00) notificationworker stdout | 2021-11-08 14:56:50,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:56:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:50 UTC)" (scheduled at 2021-11-08 14:56:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:56:50,405 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:56:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:21 UTC)" (scheduled at 2021-11-08 14:56:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:56:51,812 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:56:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:22 UTC)" (scheduled at 2021-11-08 14:56:52.617060+00:00) gcworker stdout | 2021-11-08 14:56:52,639 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:56:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:54 UTC)" (scheduled at 2021-11-08 14:56:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:56:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:54 UTC)" executed successfully securityworker stdout | 2021-11-08 14:56:54,444 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:56:54,444 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:56:54,445 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:17 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:56:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:55 UTC)" (scheduled at 2021-11-08 14:56:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:56:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:57:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:56:58 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 14:56:58,498 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:56:58 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:57:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:10 UTC)" (scheduled at 2021-11-08 14:57:00.322052+00:00) notificationworker stdout | 2021-11-08 14:57:00,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:57:01 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.060 404 0.060) gunicorn-web stdout | 2021-11-08 14:57:01,421 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:57:01 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" exportactionlogsworker stdout | 2021-11-08 14:57:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:06 UTC)" (scheduled at 2021-11-08 14:57:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:57:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:57:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:09 UTC)" (scheduled at 2021-11-08 14:57:09.376681+00:00) notificationworker stdout | 2021-11-08 14:57:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:57:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:20 UTC)" (scheduled at 2021-11-08 14:57:10.322052+00:00) notificationworker stdout | 2021-11-08 14:57:10,349 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:57:14 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:57:14,427 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:57:14 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 14:57:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:16 UTC)" (scheduled at 2021-11-08 14:57:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:57:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:57:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:47 UTC)" (scheduled at 2021-11-08 14:57:17.787050+00:00) securityworker stdout | 2021-11-08 14:57:17,808 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 14:57:17,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 14:57:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:57:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 250-290 securityworker stdout | 2021-11-08 14:57:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 82-122 securityworker stdout | 2021-11-08 14:57:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 14:57:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 14:57:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 27-67 securityworker stdout | 2021-11-08 14:57:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 14:57:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 14:57:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 14:57:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 14:57:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:57:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:57:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 14:57:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 14:57:17,837 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:57:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:57:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 14:57:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 14:57:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 14:57:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 14:57:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 14:57:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 29-69 securityworker stdout | 2021-11-08 14:57:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:57:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 14:57:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 14:57:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 14:57:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 14:57:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 14:57:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 14:57:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 14:57:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:57:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 433-464 securityworker stdout | 2021-11-08 14:57:17,870 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:57:17,878 [102] [INFO] [util.migrate.allocator] Found 35 candidates, processing block notificationworker stdout | 2021-11-08 14:57:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:30 UTC)" (scheduled at 2021-11-08 14:57:20.322052+00:00) notificationworker stdout | 2021-11-08 14:57:20,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:57:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:51 UTC)" (scheduled at 2021-11-08 14:57:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:57:21,814 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:57:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:52 UTC)" (scheduled at 2021-11-08 14:57:22.617060+00:00) gcworker stdout | 2021-11-08 14:57:22,648 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:57:23 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.003) gunicorn-registry stdout | 2021-11-08 14:57:23,539 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:57:23 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 14:57:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:27 UTC)" (scheduled at 2021-11-08 14:57:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:57:27,902 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:57:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:40 UTC)" (scheduled at 2021-11-08 14:57:30.322052+00:00) notificationworker stdout | 2021-11-08 14:57:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:40 UTC)" executed successfully securityworker stdout | 2021-11-08 14:57:32,325 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:57:32,325 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:57:32,326 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:57:47 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:57:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:57:35,274 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:57:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 14:57:35,504 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:57:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:57:35 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.006 228 0.006) notificationworker stdout | 2021-11-08 14:57:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:50 UTC)" (scheduled at 2021-11-08 14:57:40.322052+00:00) notificationworker stdout | 2021-11-08 14:57:40,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:57:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:57:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:57:42,924 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:57:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:57:45 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.091 404 0.091) gunicorn-web stdout | 2021-11-08 14:57:45,249 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:57:45 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 14:57:46,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:02:46 UTC)" (scheduled at 2021-11-08 14:57:46.131205+00:00) namespacegcworker stdout | 2021-11-08 14:57:46,149 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:02:46 UTC)" executed successfully securityworker stdout | 2021-11-08 14:57:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:17 UTC)" (scheduled at 2021-11-08 14:57:47.787050+00:00) securityworker stdout | 2021-11-08 14:57:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 14:57:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 14:57:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 14:57:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 14:57:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:57:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 14:57:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 14:57:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 14:57:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 14:57:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 14:57:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 14:57:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 14:57:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 430-464 securityworker stdout | 2021-11-08 14:57:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:57:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 14:57:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:57:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:57:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 14:57:47,850 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:57:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:57:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 14:57:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 14:57:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:57:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 14:57:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 14:57:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 14:57:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 14:57:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 14:57:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 14:57:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 14:57:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:57:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 14:57:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 14:57:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 14:57:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 14:57:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 14:57:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 14:57:47,886 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:57:47,893 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 14:57:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:00 UTC)" (scheduled at 2021-11-08 14:57:50.322052+00:00) notificationworker stdout | 2021-11-08 14:57:50,361 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:57:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:50 UTC)" (scheduled at 2021-11-08 14:57:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:57:50,409 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:57:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:21 UTC)" (scheduled at 2021-11-08 14:57:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:57:52,031 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:21 UTC)" executed successfully securityworker stdout | 2021-11-08 14:57:52,247 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:57:52,247 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:57:52,248 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:57:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:02:52 UTC)" (scheduled at 2021-11-08 14:57:52.376404+00:00) gcworker stdout | 2021-11-08 14:57:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:22 UTC)" (scheduled at 2021-11-08 14:57:52.617060+00:00) gcworker stdout | 2021-11-08 14:57:52,638 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:22 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:57:52,695 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:02:52 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:57:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:54 UTC)" (scheduled at 2021-11-08 14:57:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:57:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:57:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:55 UTC)" (scheduled at 2021-11-08 14:57:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:57:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:58:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:58:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:10 UTC)" (scheduled at 2021-11-08 14:58:00.322052+00:00) notificationworker stdout | 2021-11-08 14:58:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:10 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:58:01,407 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:01 +0000] "GET /repository/demoorg/ubi-mirror?tab=logs HTTP/1.0" 200 81214 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:01 +0000] "GET /repository/demoorg/ubi-mirror?tab=logs HTTP/2.0" 200 12916 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.009 555 0.009) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:01 +0000] "GET /api/v1/user/ HTTP/2.0" 200 1442 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.039 847 0.038) gunicorn-web stdout | 2021-11-08 14:58:01,970 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:01 +0000] "GET /api/v1/user/ HTTP/1.0" 200 1442 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/messages HTTP/2.0" 200 17 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.020 32 0.020) gunicorn-web stdout | 2021-11-08 14:58:02,002 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:58:02,200 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.046 39 0.046) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.094 47 0.094) gunicorn-web stdout | 2021-11-08 14:58:02,249 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror?includeStats=true&includeTags=false HTTP/2.0" 200 3637 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.191 73 0.191) gunicorn-web stdout | 2021-11-08 14:58:02,267 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror?includeStats=true&includeTags=false HTTP/1.0" 200 3637 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 461 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.197 422 0.197) gunicorn-web stdout | 2021-11-08 14:58:02,273 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 461 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/2.0" 200 539 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.057 53 0.057) gunicorn-web stdout | 2021-11-08 14:58:02,976 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/1.0" 200 539 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:58:03,095 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:03 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 82080 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:58:03,108 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:03 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:03 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.090 89 0.088) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:03 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 82080 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.090 83 0.074) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:03 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.241 403 0.241) gunicorn-web stdout | 2021-11-08 14:58:03,710 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:03 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" exportactionlogsworker stdout | 2021-11-08 14:58:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:06 UTC)" (scheduled at 2021-11-08 14:58:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:58:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:08 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:58:08,613 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:08 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 14:58:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:09 UTC)" (scheduled at 2021-11-08 14:58:09.376681+00:00) notificationworker stdout | 2021-11-08 14:58:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:58:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:20 UTC)" (scheduled at 2021-11-08 14:58:10.322052+00:00) notificationworker stdout | 2021-11-08 14:58:10,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:58:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:03:14 UTC)" (scheduled at 2021-11-08 14:58:14.905355+00:00) repositorygcworker stdout | 2021-11-08 14:58:14,925 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:03:14 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:15 +0000] "POST /api/v1/repository/demoorg/ubi-mirror/mirror/sync-now HTTP/2.0" 204 0 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (2.431 184 2.431) gunicorn-web stdout | 2021-11-08 14:58:15,605 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:15 +0000] "POST /api/v1/repository/demoorg/ubi-mirror/mirror/sync-now HTTP/1.0" 204 0 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 14:58:16,494 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:16 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:16 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/2.0" 200 540 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.892 398 0.892) gunicorn-web stdout | 2021-11-08 14:58:16,507 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:16 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/1.0" 200 540 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=repository-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 14:58:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:16 UTC)" (scheduled at 2021-11-08 14:58:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:58:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:16 UTC)" executed successfully securityworker stdout | 2021-11-08 14:58:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:47 UTC)" (scheduled at 2021-11-08 14:58:17.787050+00:00) securityworker stdout | 2021-11-08 14:58:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 14:58:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 14:58:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 14:58:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 14:58:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 192-232 securityworker stdout | 2021-11-08 14:58:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 14:58:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 232-272 securityworker stdout | 2021-11-08 14:58:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 14:58:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 14:58:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:58:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 14:58:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 14:58:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 14:58:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 14:58:17,956 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 14:58:17,959 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 436-464 securityworker stdout | 2021-11-08 14:58:17,962 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 14:58:17,962 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:58:17,965 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 14:58:17,967 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 14:58:17,970 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:58:17,972 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:58:17,975 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 14:58:17,977 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 14:58:17,980 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 14:58:17,982 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 14:58:17,984 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 14:58:17,986 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 14:58:17,988 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 14:58:17,990 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 14:58:17,993 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 14:58:17,995 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 426-464 securityworker stdout | 2021-11-08 14:58:17,997 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 14:58:17,998 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:58:18,006 [102] [INFO] [util.migrate.allocator] Found 39 candidates, processing block notificationworker stdout | 2021-11-08 14:58:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:30 UTC)" (scheduled at 2021-11-08 14:58:20.322052+00:00) buildlogsarchiver stdout | 2021-11-08 14:58:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:51 UTC)" (scheduled at 2021-11-08 14:58:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:58:21,879 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:51 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:58:21,880 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:30 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:22 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 14:58:22,408 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:22 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gcworker stdout | 2021-11-08 14:58:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:52 UTC)" (scheduled at 2021-11-08 14:58:22.617060+00:00) gunicorn-web stdout | 2021-11-08 14:58:22,729 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:22 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 75662 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:22 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 75662 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.397 83 1.397) gcworker stdout | 2021-11-08 14:58:23,090 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:52 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:58:23,094 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:23 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:23 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (1.763 434 1.763) securityworker stdout | 2021-11-08 14:58:25,412 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:58:25,412 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:58:25,413 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:58:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:58:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:27 UTC)" (scheduled at 2021-11-08 14:58:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:58:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:27 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:58:30,268 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:30 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 75664 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:30 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 75664 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.044 575 0.044) gunicorn-web stdout | 2021-11-08 14:58:30,307 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:30 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:30 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.085 433 0.085) notificationworker stdout | 2021-11-08 14:58:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:40 UTC)" (scheduled at 2021-11-08 14:58:30.322052+00:00) notificationworker stdout | 2021-11-08 14:58:30,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:40 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 14:58:30,499 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:58:30 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:58:30 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.098 325 0.098) gunicorn-web stdout | 2021-11-08 14:58:33,807 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:33 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:33 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.056 403 0.056) nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:14:58:34 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.094 325 0.094) gunicorn-registry stdout | 2021-11-08 14:58:34,609 [234] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:14:58:34 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-web stdout | 2021-11-08 14:58:40,118 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 75664 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 75664 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.070 83 0.070) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.093 434 0.093) gunicorn-web stdout | 2021-11-08 14:58:40,142 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:40 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 14:58:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:50 UTC)" (scheduled at 2021-11-08 14:58:40.322052+00:00) notificationworker stdout | 2021-11-08 14:58:40,342 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:58:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - demoorg+reposyncdcuser [08/Nov/2021:14:58:40 +0000] "GET /v2/auth?account=demoorg%2Breposyncdcuser&scope=repository%3Ademoorg%2Fubi-mirror%3Apull%2Cpush&service=enterprisequay.rblbank.com HTTP/1.1" 200 1055 "-" "skopeo/1.3.2-dev" (0.079 392 0.078) gunicorn-registry stdout | 2021-11-08 14:58:40,388 [245] [INFO] [gunicorn.access] 10.100.102.3 - demoorg+reposyncdcuser [08/Nov/2021:14:58:40 +0000] "GET /v2/auth?account=demoorg%2Breposyncdcuser&scope=repository%3Ademoorg%2Fubi-mirror%3Apull%2Cpush&service=enterprisequay.rblbank.com HTTP/1.1" 200 1055 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:40 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:c65299f2847308dc8c08513a39bb25252e98a01f3b6556ed3187eca2f20da3d4 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.038 1314 0.038) gunicorn-registry stdout | 2021-11-08 14:58:40,519 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:40 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:c65299f2847308dc8c08513a39bb25252e98a01f3b6556ed3187eca2f20da3d4 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" gunicorn-registry stdout | 2021-11-08 14:58:42,879 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:42 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:3c380a0657437c068edbdf33272b3f1533c7e6156431911250de6e3db1791b27 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:42 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:3c380a0657437c068edbdf33272b3f1533c7e6156431911250de6e3db1791b27 HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.026 1314 0.026) gunicorn-registry stdout | 2021-11-08 14:58:44,137 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:44 +0000] "PUT /v2/demoorg/ubi-mirror/manifests/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647 HTTP/1.1" 201 2 "-" "skopeo/1.3.2-dev" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:44 +0000] "PUT /v2/demoorg/ubi-mirror/manifests/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647 HTTP/1.1" 201 2 "-" "skopeo/1.3.2-dev" (0.036 2166 0.022) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:46 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:72b6d8cae3b9c95f65024d9681ec0f425eaf73bf9a421322f7f23ed24e42c69c HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" (0.028 1314 0.028) gunicorn-registry stdout | 2021-11-08 14:58:46,166 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:46 +0000] "HEAD /v2/demoorg/ubi-mirror/blobs/sha256:72b6d8cae3b9c95f65024d9681ec0f425eaf73bf9a421322f7f23ed24e42c69c HTTP/1.1" 200 0 "-" "skopeo/1.3.2-dev" securityworker stdout | 2021-11-08 14:58:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:17 UTC)" (scheduled at 2021-11-08 14:58:47.787050+00:00) securityworker stdout | 2021-11-08 14:58:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:58:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 14:58:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 14:58:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:58:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 14:58:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 14:58:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 14:58:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 14:58:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 14:58:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 14:58:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 14:58:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 14:58:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 14:58:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 14:58:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 439-464 securityworker stdout | 2021-11-08 14:58:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 14:58:47,858 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:58:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 33-73 securityworker stdout | 2021-11-08 14:58:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:58:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 379-419 securityworker stdout | 2021-11-08 14:58:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 14:58:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 14:58:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 14:58:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 217-257 securityworker stdout | 2021-11-08 14:58:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 14:58:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 14:58:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 257-297 securityworker stdout | 2021-11-08 14:58:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:58:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:58:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 14:58:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 14:58:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 14:58:47,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:58:47,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 460-464 securityworker stdout | 2021-11-08 14:58:47,908 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:58:47,918 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:58:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:00 UTC)" (scheduled at 2021-11-08 14:58:50.322052+00:00) notificationworker stdout | 2021-11-08 14:58:50,352 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:58:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:50 UTC)" (scheduled at 2021-11-08 14:58:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:58:50,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:50 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:58:50,910 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:50 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 76138 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:50 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/logs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 76138 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.069 83 0.069) gunicorn-web stdout | 2021-11-08 14:58:50,912 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:58:50 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/1.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:58:50 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/aggregatelogs?starttime=11%2F1%2F2021&endtime=11%2F8%2F2021 HTTP/2.0" 200 3328 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.073 432 0.072) buildlogsarchiver stdout | 2021-11-08 14:58:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:21 UTC)" (scheduled at 2021-11-08 14:58:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:58:51,829 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:21 UTC)" executed successfully gcworker stdout | 2021-11-08 14:58:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:22 UTC)" (scheduled at 2021-11-08 14:58:52.617060+00:00) gcworker stdout | 2021-11-08 14:58:52,655 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:58:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:54 UTC)" (scheduled at 2021-11-08 14:58:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:58:54,446 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:58:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:55 UTC)" (scheduled at 2021-11-08 14:58:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:58:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 14:59:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:59:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:10 UTC)" (scheduled at 2021-11-08 14:59:00.322052+00:00) notificationworker stdout | 2021-11-08 14:59:00,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:59:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:06 UTC)" (scheduled at 2021-11-08 14:59:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 14:59:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:06 UTC)" executed successfully securityworker stdout | 2021-11-08 14:59:06,598 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:59:06,598 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:59:06,599 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:59:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:09 UTC)" (scheduled at 2021-11-08 14:59:09.376681+00:00) notificationworker stdout | 2021-11-08 14:59:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:59:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:20 UTC)" (scheduled at 2021-11-08 14:59:10.322052+00:00) notificationworker stdout | 2021-11-08 14:59:10,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 14:59:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:16 UTC)" (scheduled at 2021-11-08 14:59:16.905627+00:00) repositorygcworker stdout | 2021-11-08 14:59:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:16 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:16 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.049 404 0.048) gunicorn-web stdout | 2021-11-08 14:59:16,982 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:16 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:59:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:47 UTC)" (scheduled at 2021-11-08 14:59:17.787050+00:00) securityworker stdout | 2021-11-08 14:59:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 14:59:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 14:59:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 14:59:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 14:59:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 14:59:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 14:59:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 14:59:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 93-133 securityworker stdout | 2021-11-08 14:59:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 14:59:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:59:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 14:59:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 14:59:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 14:59:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 14:59:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 294-334 securityworker stdout | 2021-11-08 14:59:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 14:59:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 334-374 securityworker stdout | 2021-11-08 14:59:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 14:59:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 14:59:17,872 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:59:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 36-76 securityworker stdout | 2021-11-08 14:59:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 14:59:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 158-198 securityworker stdout | 2021-11-08 14:59:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 14:59:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 14:59:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 14:59:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:59:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 14:59:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 14:59:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 14:59:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 14:59:17,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 14:59:17,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 14:59:17,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 14:59:17,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 14:59:17,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 14:59:17,914 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 14:59:17,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 358-398 securityworker stdout | 2021-11-08 14:59:17,917 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:59:17,927 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 14:59:19,680 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:59:19,680 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:59:19,681 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:59:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:30 UTC)" (scheduled at 2021-11-08 14:59:20.322052+00:00) notificationworker stdout | 2021-11-08 14:59:20,346 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:59:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:51 UTC)" (scheduled at 2021-11-08 14:59:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:59:21,811 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:51 UTC)" executed successfully gcworker stdout | 2021-11-08 14:59:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:52 UTC)" (scheduled at 2021-11-08 14:59:22.617060+00:00) gcworker stdout | 2021-11-08 14:59:22,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 14:59:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:59:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:27 UTC)" (scheduled at 2021-11-08 14:59:27.884604+00:00) namespacegcworker stdout | 2021-11-08 14:59:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:59:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:40 UTC)" (scheduled at 2021-11-08 14:59:30.322052+00:00) notificationworker stdout | 2021-11-08 14:59:30,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 14:59:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:50 UTC)" (scheduled at 2021-11-08 14:59:40.322052+00:00) notificationworker stdout | 2021-11-08 14:59:40,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 14:59:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:41 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.044 403 0.044) gunicorn-web stdout | 2021-11-08 14:59:41,183 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:41 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=logs" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 14:59:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:17 UTC)" (scheduled at 2021-11-08 14:59:47.787050+00:00) securityworker stdout | 2021-11-08 14:59:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 14:59:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 14:59:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 14:59:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 14:59:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 14:59:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 14:59:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 14:59:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 14:59:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 14:59:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 31-71 securityworker stdout | 2021-11-08 14:59:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 14:59:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:59:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 387-427 securityworker stdout | 2021-11-08 14:59:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 427-464 securityworker stdout | 2021-11-08 14:59:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 14:59:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 14:59:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 14:59:47,856 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:59:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 14:59:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 14:59:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 securityworker stdout | 2021-11-08 14:59:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 215-255 securityworker stdout | 2021-11-08 14:59:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 14:59:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 14:59:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 14:59:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 14:59:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 26-66 securityworker stdout | 2021-11-08 14:59:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 14:59:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 14:59:47,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 14:59:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 14:59:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 14:59:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 14:59:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 14:59:47,900 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 14:59:47,911 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 14:59:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:00 UTC)" (scheduled at 2021-11-08 14:59:50.322052+00:00) notificationworker stdout | 2021-11-08 14:59:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 14:59:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:50 UTC)" (scheduled at 2021-11-08 14:59:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 14:59:50,553 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:50 UTC)" executed successfully securityworker stdout | 2021-11-08 14:59:50,853 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 14:59:50,853 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 14:59:50,854 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 14:59:51,797 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:21 UTC)" (scheduled at 2021-11-08 14:59:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 14:59:51,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:21 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.032 449 0.031) gunicorn-web stdout | 2021-11-08 14:59:51,825 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 14:59:51,833 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.039 91 0.039) gunicorn-web stdout | 2021-11-08 14:59:51,834 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.041 78 0.040) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.072 89 0.071) gunicorn-web stdout | 2021-11-08 14:59:51,865 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.083 92 0.083) gunicorn-web stdout | 2021-11-08 14:59:51,879 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:51 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gcworker stdout | 2021-11-08 14:59:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:22 UTC)" (scheduled at 2021-11-08 14:59:52.617060+00:00) gcworker stdout | 2021-11-08 14:59:52,637 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:22 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 14:59:53,431 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:53 +0000] "GET /api/v1/repository/demoorg/ubi-mirror?includeStats=true&includeTags=false HTTP/1.0" 200 3637 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:53 +0000] "GET /api/v1/repository/demoorg/ubi-mirror?includeStats=true&includeTags=false HTTP/2.0" 200 3637 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.040 511 0.040) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:53 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 461 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.043 470 0.043) gunicorn-web stdout | 2021-11-08 14:59:53,433 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:53 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 461 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:53 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/2.0" 200 539 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.042 397 0.042) gunicorn-web stdout | 2021-11-08 14:59:53,672 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:53 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/mirror HTTP/1.0" 200 539 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:53 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.054 59 0.054) gunicorn-web stdout | 2021-11-08 14:59:53,993 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:53 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 14:59:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:54 UTC)" (scheduled at 2021-11-08 14:59:54.169080+00:00) repositorygcworker stdout | 2021-11-08 14:59:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 14:59:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:55 UTC)" (scheduled at 2021-11-08 14:59:55.131477+00:00) namespacegcworker stdout | 2021-11-08 14:59:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:00:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:55 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:dab5c03832c877dbb47f91a036c9a6fd21d80726deadce540db769800d395266 HTTP/2.0" 200 1638 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.077 159 0.077) gunicorn-web stdout | 2021-11-08 14:59:55,246 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:55 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:dab5c03832c877dbb47f91a036c9a6fd21d80726deadce540db769800d395266 HTTP/1.0" 200 1638 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:14:59:58 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:dab5c03832c877dbb47f91a036c9a6fd21d80726deadce540db769800d395266/labels HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.056 110 0.056) gunicorn-web stdout | 2021-11-08 14:59:58,806 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:14:59:58 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:dab5c03832c877dbb47f91a036c9a6fd21d80726deadce540db769800d395266/labels HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 15:00:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:10 UTC)" (scheduled at 2021-11-08 15:00:00.322052+00:00) notificationworker stdout | 2021-11-08 15:00:00,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:10 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:00:00,633 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:00:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:00:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-web stdout | 2021-11-08 15:00:02,017 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:00:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:072eb8636ab29d31123c1ce3b862ad33ef3d73628fc23b3e91e25934ec97aea2/security?vulnerabilities=true HTTP/1.0" 200 949829 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:00:02,064 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:00:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647/security?vulnerabilities=true HTTP/1.0" 200 950027 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:00:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:072eb8636ab29d31123c1ce3b862ad33ef3d73628fc23b3e91e25934ec97aea2/security?vulnerabilities=true HTTP/2.0" 200 949829 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (3.500 125 3.268) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:00:02 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:6f842d7d6d2e520c72b26fb328d96d345a0481962840026cb91e4c1275aac647/security?vulnerabilities=true HTTP/2.0" 200 950027 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (3.507 126 3.315) gunicorn-web stdout | 2021-11-08 15:00:03,057 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:00:03 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:2251147327b667388a2b9ba175fee4d44e541dbdfa1b7f9c1161f1511b8ca3e5/security?vulnerabilities=true HTTP/1.0" 200 950241 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:00:03 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/manifest/sha256:2251147327b667388a2b9ba175fee4d44e541dbdfa1b7f9c1161f1511b8ca3e5/security?vulnerabilities=true HTTP/2.0" 200 950241 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (4.386 470 4.307) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:00:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:00:04,924 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:00:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:00:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:06 UTC)" (scheduled at 2021-11-08 15:00:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:00:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:00:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:09 UTC)" (scheduled at 2021-11-08 15:00:09.376681+00:00) notificationworker stdout | 2021-11-08 15:00:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:00:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:20 UTC)" (scheduled at 2021-11-08 15:00:10.322052+00:00) notificationworker stdout | 2021-11-08 15:00:10,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:00:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:16 UTC)" (scheduled at 2021-11-08 15:00:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:00:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:00:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:47 UTC)" (scheduled at 2021-11-08 15:00:17.787050+00:00) securityworker stdout | 2021-11-08 15:00:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 15:00:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 15:00:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:00:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 15:00:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 15:00:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:00:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 15:00:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 15:00:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:00:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 260-300 securityworker stdout | 2021-11-08 15:00:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 15:00:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:00:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 15:00:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 300-340 securityworker stdout | 2021-11-08 15:00:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 15:00:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 15:00:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 15:00:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 15:00:17,867 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:00:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 15:00:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 15:00:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 15:00:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 34-74 securityworker stdout | 2021-11-08 15:00:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:00:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 15:00:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 15:00:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 15:00:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:00:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:00:17,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 307-347 securityworker stdout | 2021-11-08 15:00:17,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 347-387 securityworker stdout | 2021-11-08 15:00:17,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 15:00:17,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 204-244 securityworker stdout | 2021-11-08 15:00:17,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 15:00:17,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 15:00:17,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 15:00:17,920 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:00:17,931 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 15:00:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:30 UTC)" (scheduled at 2021-11-08 15:00:20.322052+00:00) notificationworker stdout | 2021-11-08 15:00:20,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:00:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:51 UTC)" (scheduled at 2021-11-08 15:00:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:00:21,811 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:00:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:52 UTC)" (scheduled at 2021-11-08 15:00:22.617060+00:00) gcworker stdout | 2021-11-08 15:00:22,651 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:00:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:27 UTC)" (scheduled at 2021-11-08 15:00:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:00:27,915 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:27 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:00:29 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:00:29,290 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:00:29 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:00:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:40 UTC)" (scheduled at 2021-11-08 15:00:30.322052+00:00) notificationworker stdout | 2021-11-08 15:00:30,333 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:40 UTC)" executed successfully securityworker stdout | 2021-11-08 15:00:32,892 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:00:32,892 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:00:32,893 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:00:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:00:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:50 UTC)" (scheduled at 2021-11-08 15:00:40.322052+00:00) notificationworker stdout | 2021-11-08 15:00:40,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:00:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:00:44 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 15:00:44,510 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:00:44 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:00:45 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.461 404 0.461) gunicorn-web stdout | 2021-11-08 15:00:45,525 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:00:45 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 15:00:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:17 UTC)" (scheduled at 2021-11-08 15:00:47.787050+00:00) securityworker stdout | 2021-11-08 15:00:47,914 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 15:00:47,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 15:00:47,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:00:47,923 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 15:00:47,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:00:47,928 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 15:00:47,973 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 31-71 securityworker stdout | 2021-11-08 15:00:47,976 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 217-257 securityworker stdout | 2021-11-08 15:00:47,979 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 15:00:47,982 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 257-297 securityworker stdout | 2021-11-08 15:00:47,985 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:00:47,988 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 15:00:47,991 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:00:47,993 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 15:00:47,995 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 15:00:47,997 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:00:47,999 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 454-464 securityworker stdout | 2021-11-08 15:00:47,999 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:00:48,001 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 15:00:48,003 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:00:48,006 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 15:00:48,008 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:00:48,010 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 15:00:48,012 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 15:00:48,014 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 15:00:48,017 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 15:00:48,019 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 15:00:48,021 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:00:48,023 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 15:00:48,025 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:00:48,028 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 15:00:48,030 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:00:48,032 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:00:48,035 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 15:00:48,037 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:00:48,037 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:00:48,045 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 15:00:49,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:05:49 UTC)" (scheduled at 2021-11-08 15:00:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 15:00:49,686 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:05:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:00:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:00 UTC)" (scheduled at 2021-11-08 15:00:50.322052+00:00) notificationworker stdout | 2021-11-08 15:00:50,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:00:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:50 UTC)" (scheduled at 2021-11-08 15:00:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:00:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:00:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:21 UTC)" (scheduled at 2021-11-08 15:00:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:00:51,913 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:00:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:22 UTC)" (scheduled at 2021-11-08 15:00:52.617060+00:00) gcworker stdout | 2021-11-08 15:00:52,630 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:00:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:54 UTC)" (scheduled at 2021-11-08 15:00:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:00:54,181 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:00:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:55 UTC)" (scheduled at 2021-11-08 15:00:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:00:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:01:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:01:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:10 UTC)" (scheduled at 2021-11-08 15:01:00.322052+00:00) notificationworker stdout | 2021-11-08 15:01:00,351 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:01:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:06 UTC)" (scheduled at 2021-11-08 15:01:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:01:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:01:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:09 UTC)" (scheduled at 2021-11-08 15:01:09.376681+00:00) notificationworker stdout | 2021-11-08 15:01:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:01:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:20 UTC)" (scheduled at 2021-11-08 15:01:10.322052+00:00) notificationworker stdout | 2021-11-08 15:01:10,358 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:01:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:16 UTC)" (scheduled at 2021-11-08 15:01:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:01:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:01:17,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:17 UTC)" skipped: maximum number of running instances reached (1) notificationworker stdout | 2021-11-08 15:01:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:30 UTC)" (scheduled at 2021-11-08 15:01:20.322052+00:00) notificationworker stdout | 2021-11-08 15:01:20,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:30 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:21 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 15:01:21,575 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:21 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" buildlogsarchiver stdout | 2021-11-08 15:01:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:51 UTC)" (scheduled at 2021-11-08 15:01:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:01:21,824 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:01:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:52 UTC)" (scheduled at 2021-11-08 15:01:22.617060+00:00) gcworker stdout | 2021-11-08 15:01:22,637 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:01:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:27 UTC)" (scheduled at 2021-11-08 15:01:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:01:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:27 UTC)" executed successfully securityworker stdout | 2021-11-08 15:01:29,709 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:01:29,709 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:01:29,710 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:01:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:01:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:40 UTC)" (scheduled at 2021-11-08 15:01:30.322052+00:00) notificationworker stdout | 2021-11-08 15:01:30,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:40 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 15:01:35,904 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:35 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:35 +0000] "GET /api/v1/repository/demoorg/ubi-mirror/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/demoorg/ubi-mirror?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.058 404 0.058) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.028 448 0.028) gunicorn-web stdout | 2021-11-08 15:01:38,612 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.057 89 0.057) gunicorn-web stdout | 2021-11-08 15:01:38,641 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.059 78 0.059) gunicorn-web stdout | 2021-11-08 15:01:38,643 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.074 91 0.074) gunicorn-web stdout | 2021-11-08 15:01:38,659 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:01:38,693 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:38 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.109 92 0.109) notificationworker stdout | 2021-11-08 15:01:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:50 UTC)" (scheduled at 2021-11-08 15:01:40.322052+00:00) notificationworker stdout | 2021-11-08 15:01:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:01:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:41 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:01:41,338 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:41 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:42 +0000] "GET /api/v1/organization/finacle10225 HTTP/2.0" 200 1000 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.043 433 0.043) gunicorn-web stdout | 2021-11-08 15:01:42,531 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:42 +0000] "GET /api/v1/organization/finacle10225 HTTP/1.0" 200 1000 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:42 +0000] "GET /api/v1/organization/finacle10225/prototypes HTTP/2.0" 200 19 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.027 835 0.027) gunicorn-web stdout | 2021-11-08 15:01:42,819 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:42 +0000] "GET /api/v1/organization/finacle10225/prototypes HTTP/1.0" 200 19 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:01:42,883 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:42 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:42 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/organization/finacle10225" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.052 84 0.052) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:45 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch?includeStats=true&includeTags=false HTTP/2.0" 200 3642 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.035 81 0.035) gunicorn-web stdout | 2021-11-08 15:01:45,551 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:45 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch?includeStats=true&includeTags=false HTTP/1.0" 200 3642 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:01:45,556 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:45 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:45 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.044 141 0.044) gunicorn-web stdout | 2021-11-08 15:01:46,113 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:46 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:46 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.057 411 0.057) gunicorn-web stdout | 2021-11-08 15:01:47,452 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:47 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:5ad4edc9e8d289df12956d2e99f50a70404404942b7b014a599f0e785d4552b5/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:47 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:5ad4edc9e8d289df12956d2e99f50a70404404942b7b014a599f0e785d4552b5/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.068 539 0.067) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:47 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:8f15766b20492abc29824da671f2583b26005f51cc4d0085a63e4f8be99a54c4/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.092 134 0.092) gunicorn-web stdout | 2021-11-08 15:01:47,479 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:47 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:8f15766b20492abc29824da671f2583b26005f51cc4d0085a63e4f8be99a54c4/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:47 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:ccc5d391ef8356916acbbb678f030c0c1a711b2af925d8074a9072e0914ed59d/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.098 133 0.098) gunicorn-web stdout | 2021-11-08 15:01:47,484 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:47 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:ccc5d391ef8356916acbbb678f030c0c1a711b2af925d8074a9072e0914ed59d/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 15:01:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:17 UTC)" (scheduled at 2021-11-08 15:01:47.787050+00:00) securityworker stdout | 2021-11-08 15:01:47,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 15:01:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 312-352 securityworker stdout | 2021-11-08 15:01:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:01:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 15:01:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 15:01:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:01:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 264-304 securityworker stdout | 2021-11-08 15:01:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:01:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 15:01:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:01:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 15:01:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:01:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 15:01:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:01:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:01:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 15:01:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:01:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:01:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 15:01:47,847 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:01:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:01:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 15:01:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 32-72 securityworker stdout | 2021-11-08 15:01:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 15:01:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 15:01:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 15:01:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 15:01:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 15:01:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 15:01:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 15:01:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:01:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 15:01:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 15:01:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 15:01:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 260-300 securityworker stdout | 2021-11-08 15:01:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 15:01:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 15:01:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 447-464 securityworker stdout | 2021-11-08 15:01:47,887 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:01:47,894 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block gunicorn-web stdout | 2021-11-08 15:01:50,214 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:01:50 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:493e6260308491ea7bc4b59e9b784145264b4dccb25293f0c5e5000040e3cbce/security?vulnerabilities=true HTTP/1.0" 200 864927 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:01:50 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/manifest/sha256:493e6260308491ea7bc4b59e9b784145264b4dccb25293f0c5e5000040e3cbce/security?vulnerabilities=true HTTP/2.0" 200 864927 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (2.888 133 2.828) notificationworker stdout | 2021-11-08 15:01:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:00 UTC)" (scheduled at 2021-11-08 15:01:50.322052+00:00) notificationworker stdout | 2021-11-08 15:01:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:01:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:50 UTC)" (scheduled at 2021-11-08 15:01:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:01:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:01:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:21 UTC)" (scheduled at 2021-11-08 15:01:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:01:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:01:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:22 UTC)" (scheduled at 2021-11-08 15:01:52.617060+00:00) gcworker stdout | 2021-11-08 15:01:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:01:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:54 UTC)" (scheduled at 2021-11-08 15:01:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:01:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:01:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:55 UTC)" (scheduled at 2021-11-08 15:01:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:01:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:02:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:02:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:10 UTC)" (scheduled at 2021-11-08 15:02:00.322052+00:00) notificationworker stdout | 2021-11-08 15:02:00,351 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:02:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:06 UTC)" (scheduled at 2021-11-08 15:02:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:02:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:02:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:09 UTC)" (scheduled at 2021-11-08 15:02:09.376681+00:00) notificationworker stdout | 2021-11-08 15:02:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:02:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:20 UTC)" (scheduled at 2021-11-08 15:02:10.322052+00:00) notificationworker stdout | 2021-11-08 15:02:10,345 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:02:10 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.139 325 0.139) gunicorn-registry stdout | 2021-11-08 15:02:10,727 [234] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:02:10 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 15:02:12,389 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:02:12,389 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:02:12,390 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:02:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:16 UTC)" (scheduled at 2021-11-08 15:02:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:02:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:16 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:02:17 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.087 325 0.086) gunicorn-registry stdout | 2021-11-08 15:02:17,494 [240] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:02:17 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 15:02:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:47 UTC)" (scheduled at 2021-11-08 15:02:17.787050+00:00) securityworker stdout | 2021-11-08 15:02:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 15:02:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 15:02:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 152-192 securityworker stdout | 2021-11-08 15:02:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 15:02:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 15:02:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 15:02:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 15:02:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 15:02:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:02:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 193-233 securityworker stdout | 2021-11-08 15:02:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 15:02:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 192-232 securityworker stdout | 2021-11-08 15:02:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 15:02:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:02:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 15:02:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 15:02:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 15:02:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:02:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 15:02:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 15:02:17,883 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:02:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 15:02:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 15-55 securityworker stdout | 2021-11-08 15:02:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 15:02:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 15:02:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 15:02:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 15:02:17,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 15:02:17,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 15:02:17,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:02:17,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 146-186 securityworker stdout | 2021-11-08 15:02:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:02:17,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 15:02:17,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 15:02:17,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 15:02:17,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 15:02:17,924 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 15:02:17,926 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 454-464 securityworker stdout | 2021-11-08 15:02:17,926 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:02:17,934 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:02:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:30 UTC)" (scheduled at 2021-11-08 15:02:20.322052+00:00) notificationworker stdout | 2021-11-08 15:02:20,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:02:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:51 UTC)" (scheduled at 2021-11-08 15:02:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:02:21,827 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:02:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:52 UTC)" (scheduled at 2021-11-08 15:02:22.617060+00:00) gcworker stdout | 2021-11-08 15:02:22,652 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:02:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:27 UTC)" (scheduled at 2021-11-08 15:02:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:02:27,920 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:27 UTC)" executed successfully securityworker stdout | 2021-11-08 15:02:29,685 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:02:29,686 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:02:29,687 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:02:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:02:30,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:40 UTC)" (scheduled at 2021-11-08 15:02:30.322052+00:00) notificationworker stdout | 2021-11-08 15:02:30,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:40 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:02:33,741 [239] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:02:33 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:02:33 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.221 325 0.221) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:34 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.044 411 0.044) gunicorn-web stdout | 2021-11-08 15:02:34,223 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:34 +0000] "GET /api/v1/repository/finacle10225/fincore_finbranch/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_finbranch?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 15:02:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:50 UTC)" (scheduled at 2021-11-08 15:02:40.322052+00:00) notificationworker stdout | 2021-11-08 15:02:40,342 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:02:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:02:40 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.108 325 0.108) gunicorn-registry stdout | 2021-11-08 15:02:40,408 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:02:40 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-web stdout | 2021-11-08 15:02:42,970 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:42 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:42 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.028 448 0.028) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:42 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.045 78 0.045) gunicorn-web stdout | 2021-11-08 15:02:42,987 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:42 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:02:42,994 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:42 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:42 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.052 89 0.052) gunicorn-web stdout | 2021-11-08 15:02:42,996 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:42 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:42 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.051 92 0.051) gunicorn-web stdout | 2021-11-08 15:02:43,029 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:43 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:43 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.088 91 0.088) gunicorn-registry stdout | 2021-11-08 15:02:43,614 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:02:43 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:02:43 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.097 325 0.097) namespacegcworker stdout | 2021-11-08 15:02:46,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:07:46 UTC)" (scheduled at 2021-11-08 15:02:46.131205+00:00) namespacegcworker stdout | 2021-11-08 15:02:46,152 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:07:46 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:46 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm?includeStats=true&includeTags=false HTTP/2.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.037 515 0.037) gunicorn-web stdout | 2021-11-08 15:02:46,928 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:46 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm?includeStats=true&includeTags=false HTTP/1.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:46 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.050 477 0.050) gunicorn-web stdout | 2021-11-08 15:02:46,940 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:46 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1847 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-registry stdout | 2021-11-08 15:02:47,026 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:02:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:02:47 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.083 325 0.083) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:47 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.048 408 0.047) gunicorn-web stdout | 2021-11-08 15:02:47,479 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:47 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 15:02:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:17 UTC)" (scheduled at 2021-11-08 15:02:47.787050+00:00) securityworker stdout | 2021-11-08 15:02:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 36-76 securityworker stdout | 2021-11-08 15:02:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:02:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 15:02:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 15:02:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 15:02:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 15:02:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 15:02:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 15:02:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:02:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 15:02:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 15:02:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 15:02:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 15:02:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 15:02:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 439-464 securityworker stdout | 2021-11-08 15:02:47,853 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:02:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:02:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 15:02:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 15:02:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:02:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 15:02:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:02:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:02:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 15:02:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 37-77 securityworker stdout | 2021-11-08 15:02:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 15:02:47,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 15:02:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:02:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 15:02:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 15:02:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 77-117 securityworker stdout | 2021-11-08 15:02:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:02:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 15:02:47,905 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:02:47,914 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:49 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.064 129 0.064) gunicorn-web stdout | 2021-11-08 15:02:49,108 [214] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:49 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:5dae96222c3d75cc72eb0081451eff5fdc509b20683f2be35565ce1fa115f8d2/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 15:02:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:00 UTC)" (scheduled at 2021-11-08 15:02:50.322052+00:00) notificationworker stdout | 2021-11-08 15:02:50,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:02:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:50 UTC)" (scheduled at 2021-11-08 15:02:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:02:50,423 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:02:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:21 UTC)" (scheduled at 2021-11-08 15:02:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:02:51,821 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:02:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:07:52 UTC)" (scheduled at 2021-11-08 15:02:52.376404+00:00) notificationworker stdout | 2021-11-08 15:02:52,410 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:07:52 UTC)" executed successfully gcworker stdout | 2021-11-08 15:02:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:22 UTC)" (scheduled at 2021-11-08 15:02:52.617060+00:00) gcworker stdout | 2021-11-08 15:02:52,647 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:22 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 15:02:52,943 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:52 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:0af14d73008fda0f2f7601453ccf022a3317316051d6023ea679853b77e20b98/security?vulnerabilities=true HTTP/1.0" 200 863904 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:53 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:0af14d73008fda0f2f7601453ccf022a3317316051d6023ea679853b77e20b98/security?vulnerabilities=true HTTP/2.0" 200 863904 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (4.413 129 3.905) repositorygcworker stdout | 2021-11-08 15:02:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:54 UTC)" (scheduled at 2021-11-08 15:02:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:02:54,202 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:54 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 15:02:54,469 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:54 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:ff6563f0c17435ee75f82581f2aeb0a859586ee2e7f9c4e3d886bedf68bf4290/security?vulnerabilities=true HTTP/1.0" 200 863904 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:02:54,486 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:02:54 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:863e09b600030be272b99e063c9bd85b5b5bf3d3b4d4c845e98de055319ac39d/security?vulnerabilities=true HTTP/1.0" 200 869701 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 15:02:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:55 UTC)" (scheduled at 2021-11-08 15:02:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:02:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:03:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:55 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:ff6563f0c17435ee75f82581f2aeb0a859586ee2e7f9c4e3d886bedf68bf4290/security?vulnerabilities=true HTTP/2.0" 200 863904 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (6.148 532 5.434) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:02:55 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/manifest/sha256:863e09b600030be272b99e063c9bd85b5b5bf3d3b4d4c845e98de055319ac39d/security?vulnerabilities=true HTTP/2.0" 200 869701 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (6.495 130 5.442) expiredappspecifictokenworker stdout | 2021-11-08 15:02:56,908 [67] [INFO] [apscheduler.executors.default] Running job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2021-11-08 15:02:56 UTC)" (scheduled at 2021-11-08 15:02:56.907050+00:00) expiredappspecifictokenworker stdout | 2021-11-08 15:02:56,930 [67] [INFO] [apscheduler.executors.default] Job "ExpiredAppSpecificTokenWorker._gc_expired_tokens (trigger: interval[1:00:00], next run at: 2021-11-08 16:02:56 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:03:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:10 UTC)" (scheduled at 2021-11-08 15:03:00.322052+00:00) notificationworker stdout | 2021-11-08 15:03:00,346 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:03:02 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.139 47 0.138) gunicorn-web stdout | 2021-11-08 15:03:02,463 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:03:02 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:03:02 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.300 383 0.299) gunicorn-web stdout | 2021-11-08 15:03:02,624 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:03:02 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" exportactionlogsworker stdout | 2021-11-08 15:03:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:06 UTC)" (scheduled at 2021-11-08 15:03:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:03:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:06 UTC)" executed successfully securityworker stdout | 2021-11-08 15:03:07,651 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:03:07,651 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:03:07,652 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:03:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:09 UTC)" (scheduled at 2021-11-08 15:03:09.376681+00:00) notificationworker stdout | 2021-11-08 15:03:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:03:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:20 UTC)" (scheduled at 2021-11-08 15:03:10.322052+00:00) notificationworker stdout | 2021-11-08 15:03:10,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:03:14 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.100 325 0.100) gunicorn-registry stdout | 2021-11-08 15:03:14,733 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:03:14 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:03:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:08:14 UTC)" (scheduled at 2021-11-08 15:03:14.905355+00:00) repositorygcworker stdout | 2021-11-08 15:03:14,922 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:08:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:03:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:16 UTC)" (scheduled at 2021-11-08 15:03:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:03:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:03:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:47 UTC)" (scheduled at 2021-11-08 15:03:17.787050+00:00) securityworker stdout | 2021-11-08 15:03:17,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 15:03:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 15:03:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:03:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 15:03:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 15:03:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:03:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:03:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 93-133 securityworker stdout | 2021-11-08 15:03:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:03:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 15:03:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:03:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 15:03:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 15:03:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 15:03:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 15:03:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 15:03:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:03:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 15:03:17,846 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:03:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 15:03:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 15:03:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 15:03:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:03:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 15:03:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 15:03:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 15:03:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 15:03:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 securityworker stdout | 2021-11-08 15:03:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 380-420 securityworker stdout | 2021-11-08 15:03:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 15:03:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:03:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 19-59 securityworker stdout | 2021-11-08 15:03:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 15:03:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 15:03:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:03:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 15:03:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 15:03:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 15:03:17,890 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:03:17,896 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 15:03:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:30 UTC)" (scheduled at 2021-11-08 15:03:20.322052+00:00) notificationworker stdout | 2021-11-08 15:03:20,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:03:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:51 UTC)" (scheduled at 2021-11-08 15:03:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:03:21,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:03:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:52 UTC)" (scheduled at 2021-11-08 15:03:22.617060+00:00) gcworker stdout | 2021-11-08 15:03:22,639 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:52 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:03:25,964 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:03:25 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:03:25 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.265 325 0.265) securityworker stdout | 2021-11-08 15:03:27,641 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:03:27,641 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:03:27,642 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:03:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:03:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:27 UTC)" (scheduled at 2021-11-08 15:03:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:03:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:03:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:40 UTC)" (scheduled at 2021-11-08 15:03:30.322052+00:00) notificationworker stdout | 2021-11-08 15:03:30,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:40 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:03:31,423 [240] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:03:31 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 272 0.003) gunicorn-registry stdout | 2021-11-08 15:03:31,424 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:03:31 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 15:03:39,827 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:03:39 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:03:39 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finrptcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1692 0.016) notificationworker stdout | 2021-11-08 15:03:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:50 UTC)" (scheduled at 2021-11-08 15:03:40.322052+00:00) notificationworker stdout | 2021-11-08 15:03:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:03:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:03:43,634 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:03:43 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:03:43 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) securityworker stdout | 2021-11-08 15:03:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:17 UTC)" (scheduled at 2021-11-08 15:03:47.787050+00:00) securityworker stdout | 2021-11-08 15:03:47,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 15:03:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 15:03:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 217-257 securityworker stdout | 2021-11-08 15:03:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 15:03:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 35-75 securityworker stdout | 2021-11-08 15:03:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 15:03:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 15:03:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:03:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 15:03:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 15:03:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 15:03:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 15:03:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 15:03:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 15:03:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 387-427 securityworker stdout | 2021-11-08 15:03:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 15:03:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 427-464 securityworker stdout | 2021-11-08 15:03:47,844 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:03:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 15:03:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 38-78 securityworker stdout | 2021-11-08 15:03:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 15:03:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:03:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 15:03:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:03:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 391-431 securityworker stdout | 2021-11-08 15:03:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 431-464 securityworker stdout | 2021-11-08 15:03:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 15:03:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 294-334 securityworker stdout | 2021-11-08 15:03:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 15:03:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 334-374 securityworker stdout | 2021-11-08 15:03:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 15:03:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 15:03:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:03:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 15:03:47,876 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:03:47,884 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:03:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:00 UTC)" (scheduled at 2021-11-08 15:03:50.322052+00:00) notificationworker stdout | 2021-11-08 15:03:50,346 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:03:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:50 UTC)" (scheduled at 2021-11-08 15:03:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:03:50,413 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:03:51,173 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:03:51,173 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:03:51,174 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:03:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:21 UTC)" (scheduled at 2021-11-08 15:03:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:03:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:03:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:22 UTC)" (scheduled at 2021-11-08 15:03:52.617060+00:00) gcworker stdout | 2021-11-08 15:03:52,631 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:03:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:54 UTC)" (scheduled at 2021-11-08 15:03:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:03:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:03:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:55 UTC)" (scheduled at 2021-11-08 15:03:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:03:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:04:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:04:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:10 UTC)" (scheduled at 2021-11-08 15:04:00.322052+00:00) notificationworker stdout | 2021-11-08 15:04:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:04:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:06 UTC)" (scheduled at 2021-11-08 15:04:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:04:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:04:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:09 UTC)" (scheduled at 2021-11-08 15:04:09.376681+00:00) notificationworker stdout | 2021-11-08 15:04:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:04:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:20 UTC)" (scheduled at 2021-11-08 15:04:10.322052+00:00) notificationworker stdout | 2021-11-08 15:04:10,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:04:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:16 UTC)" (scheduled at 2021-11-08 15:04:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:04:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:04:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:47 UTC)" (scheduled at 2021-11-08 15:04:17.787050+00:00) securityworker stdout | 2021-11-08 15:04:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 15:04:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 15:04:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:04:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 15:04:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 15:04:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 15:04:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 15:04:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:04:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 15:04:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:04:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 15:04:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 15:04:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 15:04:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 430-464 securityworker stdout | 2021-11-08 15:04:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:04:17,864 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:04:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 15:04:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 15:04:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 15:04:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 15:04:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 15:04:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 15:04:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 15:04:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 15:04:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 15:04:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 15:04:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 447-464 securityworker stdout | 2021-11-08 15:04:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 15:04:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:04:17,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:04:17,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:04:17,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 15:04:17,904 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:04:17,913 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:04:20,270 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:04:20,270 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:04:20,271 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:04:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:30 UTC)" (scheduled at 2021-11-08 15:04:20.322052+00:00) notificationworker stdout | 2021-11-08 15:04:20,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:04:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:51 UTC)" (scheduled at 2021-11-08 15:04:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:04:21,818 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:04:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:52 UTC)" (scheduled at 2021-11-08 15:04:22.617060+00:00) gcworker stdout | 2021-11-08 15:04:22,676 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:04:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:04:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:27 UTC)" (scheduled at 2021-11-08 15:04:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:04:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:04:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:40 UTC)" (scheduled at 2021-11-08 15:04:30.322052+00:00) notificationworker stdout | 2021-11-08 15:04:30,345 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:04:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:50 UTC)" (scheduled at 2021-11-08 15:04:40.322052+00:00) notificationworker stdout | 2021-11-08 15:04:40,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:04:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:04:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:17 UTC)" (scheduled at 2021-11-08 15:04:47.787050+00:00) securityworker stdout | 2021-11-08 15:04:47,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 15:04:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:04:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 15:04:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 15:04:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 15:04:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 15:04:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 15:04:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:04:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 15:04:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 426-464 securityworker stdout | 2021-11-08 15:04:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 15:04:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 113-153 securityworker stdout | 2021-11-08 15:04:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 15:04:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 15:04:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:04:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:04:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 15:04:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 15:04:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 15:04:47,845 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:04:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 15:04:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:04:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:04:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 15:04:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 15:04:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 15:04:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 15:04:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 15:04:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 15:04:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 15:04:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:04:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 15:04:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 15:04:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 35-75 securityworker stdout | 2021-11-08 15:04:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 15:04:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:04:47,877 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:04:47,887 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:04:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:00 UTC)" (scheduled at 2021-11-08 15:04:50.322052+00:00) notificationworker stdout | 2021-11-08 15:04:50,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:04:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:50 UTC)" (scheduled at 2021-11-08 15:04:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:04:50,409 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:04:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:21 UTC)" (scheduled at 2021-11-08 15:04:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:04:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:04:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:22 UTC)" (scheduled at 2021-11-08 15:04:52.617060+00:00) gcworker stdout | 2021-11-08 15:04:52,637 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:04:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:54 UTC)" (scheduled at 2021-11-08 15:04:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:04:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:04:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:55 UTC)" (scheduled at 2021-11-08 15:04:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:04:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:05:55 UTC)" executed successfully securityworker stdout | 2021-11-08 15:04:55,741 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:04:55,741 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:04:55,742 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:05:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:10 UTC)" (scheduled at 2021-11-08 15:05:00.322052+00:00) notificationworker stdout | 2021-11-08 15:05:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:05:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:06 UTC)" (scheduled at 2021-11-08 15:05:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:05:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:05:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:09 UTC)" (scheduled at 2021-11-08 15:05:09.376681+00:00) notificationworker stdout | 2021-11-08 15:05:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:05:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:20 UTC)" (scheduled at 2021-11-08 15:05:10.322052+00:00) notificationworker stdout | 2021-11-08 15:05:10,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:11 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1690 0.014) gunicorn-registry stdout | 2021-11-08 15:05:11,753 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:11 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 15:05:14,085 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:14 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:14 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1689 0.015) repositorygcworker stdout | 2021-11-08 15:05:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:16 UTC)" (scheduled at 2021-11-08 15:05:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:05:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:05:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:47 UTC)" (scheduled at 2021-11-08 15:05:17.787050+00:00) securityworker stdout | 2021-11-08 15:05:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 15:05:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 15:05:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 312-352 securityworker stdout | 2021-11-08 15:05:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 15:05:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 15:05:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 15:05:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 15:05:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:05:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 15:05:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:05:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 15:05:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 15:05:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 15:05:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 15:05:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 434-464 securityworker stdout | 2021-11-08 15:05:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 353-393 securityworker stdout | 2021-11-08 15:05:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 15:05:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 15:05:17,846 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:05:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:05:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:05:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:05:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 15:05:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 15:05:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 15:05:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 15:05:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 15:05:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 15:05:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 24-64 securityworker stdout | 2021-11-08 15:05:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 15:05:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:05:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 15:05:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 15:05:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 15:05:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:05:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 15:05:17,884 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:05:17,894 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:05:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:30 UTC)" (scheduled at 2021-11-08 15:05:20.322052+00:00) notificationworker stdout | 2021-11-08 15:05:20,355 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:30 UTC)" executed successfully securityworker stdout | 2021-11-08 15:05:20,698 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:05:20,699 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:05:20,699 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:05:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:51 UTC)" (scheduled at 2021-11-08 15:05:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:05:21,827 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:05:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:52 UTC)" (scheduled at 2021-11-08 15:05:22.617060+00:00) gcworker stdout | 2021-11-08 15:05:22,651 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:05:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:26 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.140 408 0.138) gunicorn-web stdout | 2021-11-08 15:05:26,092 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:26 +0000] "GET /api/v1/repository/finacle10225/fincore_mqm/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_mqm?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" namespacegcworker stdout | 2021-11-08 15:05:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:27 UTC)" (scheduled at 2021-11-08 15:05:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:05:27,902 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:05:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:40 UTC)" (scheduled at 2021-11-08 15:05:30.322052+00:00) notificationworker stdout | 2021-11-08 15:05:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/2.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.028 447 0.028) gunicorn-web stdout | 2021-11-08 15:05:30,446 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&popularity=true&starred=true HTTP/1.0" 200 21 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/2.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.044 78 0.044) gunicorn-web stdout | 2021-11-08 15:05:30,461 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&namespace=13038&popularity=true&state=true HTTP/1.0" 200 213 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:05:30,462 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/1.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&namespace=rblfinacle&popularity=true&public=false&state=true HTTP/2.0" 200 207 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.041 91 0.041) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/2.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.040 92 0.040) gunicorn-web stdout | 2021-11-08 15:05:30,462 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&namespace=finacle10225&popularity=true&public=false&state=true HTTP/1.0" 200 2812 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/2.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.075 89 0.075) gunicorn-web stdout | 2021-11-08 15:05:30,492 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:30 +0000] "GET /api/v1/repository?last_modified=true&namespace=demoorg&popularity=true&public=false&state=true HTTP/1.0" 200 212 "https://enterprisequay.rblbank.com/repository/" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:32 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.028 1690 0.028) gunicorn-registry stdout | 2021-11-08 15:05:32,452 [234] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:32 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-web stdout | 2021-11-08 15:05:36,490 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:36 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc?includeStats=true&includeTags=false HTTP/1.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:36 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc?includeStats=true&includeTags=false HTTP/2.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.036 515 0.036) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:36 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.050 475 0.049) gunicorn-web stdout | 2021-11-08 15:05:36,498 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:36 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:37 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.041 406 0.041) gunicorn-web stdout | 2021-11-08 15:05:37,067 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:37 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:05:38,685 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:38 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:513113d7196ee0f843dd54d91f1ca8d1438986fa67fa06e9514ca10ee9ce2753/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:05:38,686 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:38 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:6913e319ab201ccb2e5eb60a5928927d2a8327a938d21e73c1423ca92582bfff/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:38 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:513113d7196ee0f843dd54d91f1ca8d1438986fa67fa06e9514ca10ee9ce2753/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.061 129 0.061) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:38 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:6913e319ab201ccb2e5eb60a5928927d2a8327a938d21e73c1423ca92582bfff/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.060 129 0.060) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:38 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:ee7592999fa5639d5a3a765b9f0d8c22b5af36be1b477b7ae6bcdba60b7b3c5f/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.090 532 0.090) gunicorn-web stdout | 2021-11-08 15:05:38,715 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:38 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:ee7592999fa5639d5a3a765b9f0d8c22b5af36be1b477b7ae6bcdba60b7b3c5f/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 15:05:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:50 UTC)" (scheduled at 2021-11-08 15:05:40.322052+00:00) notificationworker stdout | 2021-11-08 15:05:40,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:05:50 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 15:05:40,553 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:40 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:a466d1a9e3ccaf1378212c87ef24728fac21ef7cf2b54b6e53cb686aaf2a973f/security?vulnerabilities=true HTTP/1.0" 200 863301 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:40 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:a466d1a9e3ccaf1378212c87ef24728fac21ef7cf2b54b6e53cb686aaf2a973f/security?vulnerabilities=true HTTP/2.0" 200 863301 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (2.004 129 1.927) securityworker stdout | 2021-11-08 15:05:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:17 UTC)" (scheduled at 2021-11-08 15:05:47.787050+00:00) securityworker stdout | 2021-11-08 15:05:47,808 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 15:05:47,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:05:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 15:05:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 15:05:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:05:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 15:05:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 15:05:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 15:05:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 15:05:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 15:05:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 15:05:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 15:05:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 15:05:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 15:05:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 15:05:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 15:05:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:05:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 15:05:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 15:05:47,847 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:05:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:05:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 15:05:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 15:05:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 148-188 securityworker stdout | 2021-11-08 15:05:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:05:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:05:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 15:05:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 15:05:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 15:05:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 15:05:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 15:05:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 15:05:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 15:05:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 15:05:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 15:05:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 15:05:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 443-464 securityworker stdout | 2021-11-08 15:05:47,885 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:05:47,893 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 15:05:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:10:49 UTC)" (scheduled at 2021-11-08 15:05:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 15:05:49,462 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:10:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:05:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:00 UTC)" (scheduled at 2021-11-08 15:05:50.322052+00:00) notificationworker stdout | 2021-11-08 15:05:50,347 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:05:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:50 UTC)" (scheduled at 2021-11-08 15:05:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:05:50,417 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:05:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:21 UTC)" (scheduled at 2021-11-08 15:05:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:05:51,823 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:05:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:22 UTC)" (scheduled at 2021-11-08 15:05:52.617060+00:00) gcworker stdout | 2021-11-08 15:05:52,644 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:22 UTC)" executed successfully securityworker stdout | 2021-11-08 15:05:53,981 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:05:53,982 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:05:53,982 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:05:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:54 UTC)" (scheduled at 2021-11-08 15:05:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:05:54,193 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:54 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:05:55,063 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:05:55 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:05:55 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1690 0.017) namespacegcworker stdout | 2021-11-08 15:05:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:55 UTC)" (scheduled at 2021-11-08 15:05:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:05:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:06:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:06:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:10 UTC)" (scheduled at 2021-11-08 15:06:00.322052+00:00) notificationworker stdout | 2021-11-08 15:06:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:06:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:06 UTC)" (scheduled at 2021-11-08 15:06:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:06:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:06:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:09 UTC)" (scheduled at 2021-11-08 15:06:09.376681+00:00) notificationworker stdout | 2021-11-08 15:06:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:06:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:20 UTC)" (scheduled at 2021-11-08 15:06:10.322052+00:00) notificationworker stdout | 2021-11-08 15:06:10,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:06:14 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.051 407 0.051) gunicorn-web stdout | 2021-11-08 15:06:14,120 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:06:14 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 15:06:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:16 UTC)" (scheduled at 2021-11-08 15:06:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:06:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:06:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:47 UTC)" (scheduled at 2021-11-08 15:06:17.787050+00:00) securityworker stdout | 2021-11-08 15:06:17,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 15:06:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 15:06:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 15:06:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 24-64 securityworker stdout | 2021-11-08 15:06:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 15:06:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 15:06:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:06:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:06:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 15:06:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 15:06:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 15:06:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 15:06:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:06:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 15:06:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 15:06:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 444-464 securityworker stdout | 2021-11-08 15:06:17,851 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:06:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 15:06:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 434-464 securityworker stdout | 2021-11-08 15:06:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 15:06:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 15:06:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 15:06:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 15:06:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 15:06:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:06:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 15:06:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 15:06:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:06:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 15:06:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 15:06:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:06:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 15:06:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 15:06:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 15:06:17,889 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:06:17,898 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:06:18,810 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:06:18,811 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:06:18,811 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:06:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:30 UTC)" (scheduled at 2021-11-08 15:06:20.322052+00:00) notificationworker stdout | 2021-11-08 15:06:20,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:06:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:51 UTC)" (scheduled at 2021-11-08 15:06:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:06:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:06:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:52 UTC)" (scheduled at 2021-11-08 15:06:22.617060+00:00) gcworker stdout | 2021-11-08 15:06:22,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:06:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:06:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:27 UTC)" (scheduled at 2021-11-08 15:06:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:06:27,898 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:06:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:40 UTC)" (scheduled at 2021-11-08 15:06:30.322052+00:00) notificationworker stdout | 2021-11-08 15:06:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:06:30 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1690 0.013) gunicorn-registry stdout | 2021-11-08 15:06:30,642 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:06:30 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:06:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:50 UTC)" (scheduled at 2021-11-08 15:06:40.322052+00:00) notificationworker stdout | 2021-11-08 15:06:40,342 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:06:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:06:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:17 UTC)" (scheduled at 2021-11-08 15:06:47.787050+00:00) securityworker stdout | 2021-11-08 15:06:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 15:06:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 15:06:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 15:06:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 15:06:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 15:06:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 15:06:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:06:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 15:06:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 307-347 securityworker stdout | 2021-11-08 15:06:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 146-186 securityworker stdout | 2021-11-08 15:06:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 15:06:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 15:06:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 360-400 securityworker stdout | 2021-11-08 15:06:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 15:06:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 186-226 securityworker stdout | 2021-11-08 15:06:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 454-464 securityworker stdout | 2021-11-08 15:06:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 15:06:47,856 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:06:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 15:06:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 15:06:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 15:06:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 15:06:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 340-380 securityworker stdout | 2021-11-08 15:06:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:06:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 15:06:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 15:06:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:06:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 15:06:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 380-420 securityworker stdout | 2021-11-08 15:06:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 15:06:47,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 15:06:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:06:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 15:06:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 447-464 securityworker stdout | 2021-11-08 15:06:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 15:06:47,901 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:06:47,908 [102] [INFO] [util.migrate.allocator] Found 12 candidates, processing block notificationworker stdout | 2021-11-08 15:06:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:00 UTC)" (scheduled at 2021-11-08 15:06:50.322052+00:00) notificationworker stdout | 2021-11-08 15:06:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:06:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:50 UTC)" (scheduled at 2021-11-08 15:06:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:06:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:06:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:21 UTC)" (scheduled at 2021-11-08 15:06:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:06:51,811 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:21 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:06:52 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.051 407 0.050) gunicorn-web stdout | 2021-11-08 15:06:52,517 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:06:52 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gcworker stdout | 2021-11-08 15:06:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:22 UTC)" (scheduled at 2021-11-08 15:06:52.617060+00:00) gcworker stdout | 2021-11-08 15:06:52,648 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:06:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:54 UTC)" (scheduled at 2021-11-08 15:06:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:06:54,195 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:06:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:55 UTC)" (scheduled at 2021-11-08 15:06:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:06:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:07:55 UTC)" executed successfully securityworker stdout | 2021-11-08 15:06:59,087 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:06:59,087 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:06:59,088 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:07:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:10 UTC)" (scheduled at 2021-11-08 15:07:00.322052+00:00) notificationworker stdout | 2021-11-08 15:07:00,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:07:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:06 UTC)" (scheduled at 2021-11-08 15:07:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:07:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:07:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:09 UTC)" (scheduled at 2021-11-08 15:07:09.376681+00:00) notificationworker stdout | 2021-11-08 15:07:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:07:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:20 UTC)" (scheduled at 2021-11-08 15:07:10.322052+00:00) notificationworker stdout | 2021-11-08 15:07:10,351 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:07:10 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.063 406 0.063) gunicorn-web stdout | 2021-11-08 15:07:10,464 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:07:10 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 15:07:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:16 UTC)" (scheduled at 2021-11-08 15:07:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:07:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:07:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:47 UTC)" (scheduled at 2021-11-08 15:07:17.787050+00:00) securityworker stdout | 2021-11-08 15:07:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 36-76 securityworker stdout | 2021-11-08 15:07:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 15:07:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 15:07:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 15:07:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 15:07:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:07:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 15:07:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 15:07:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:07:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 192-232 securityworker stdout | 2021-11-08 15:07:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 15:07:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 15:07:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 232-272 securityworker stdout | 2021-11-08 15:07:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 15:07:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 15:07:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:07:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 15:07:17,845 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:07:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 15:07:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 15:07:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 15:07:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 336-376 securityworker stdout | 2021-11-08 15:07:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:07:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 15:07:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 15:07:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 15:07:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:07:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:07:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 15:07:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 15:07:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 158-198 securityworker stdout | 2021-11-08 15:07:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 152-192 securityworker stdout | 2021-11-08 15:07:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:07:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 15:07:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 15:07:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 446-464 securityworker stdout | 2021-11-08 15:07:17,883 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:07:17,891 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:07:20,071 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:07:20,071 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:07:20,072 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:07:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:30 UTC)" (scheduled at 2021-11-08 15:07:20.322052+00:00) notificationworker stdout | 2021-11-08 15:07:20,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:30 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:07:20 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:07:20,387 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:07:20 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" buildlogsarchiver stdout | 2021-11-08 15:07:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:51 UTC)" (scheduled at 2021-11-08 15:07:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:07:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:51 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:07:22 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:07:22,495 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:07:22 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gcworker stdout | 2021-11-08 15:07:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:52 UTC)" (scheduled at 2021-11-08 15:07:22.617060+00:00) gcworker stdout | 2021-11-08 15:07:22,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:07:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:07:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:27 UTC)" (scheduled at 2021-11-08 15:07:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:07:27,898 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:07:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:40 UTC)" (scheduled at 2021-11-08 15:07:30.322052+00:00) notificationworker stdout | 2021-11-08 15:07:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:07:36 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:07:36,495 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:07:36 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:07:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:50 UTC)" (scheduled at 2021-11-08 15:07:40.322052+00:00) notificationworker stdout | 2021-11-08 15:07:40,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:07:50 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:07:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:12:46 UTC)" (scheduled at 2021-11-08 15:07:46.131205+00:00) namespacegcworker stdout | 2021-11-08 15:07:46,149 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:12:46 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:07:46 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.000) gunicorn-registry stdout | 2021-11-08 15:07:46,335 [238] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:07:46 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 15:07:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:17 UTC)" (scheduled at 2021-11-08 15:07:47.787050+00:00) securityworker stdout | 2021-11-08 15:07:47,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 15:07:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 392-432 securityworker stdout | 2021-11-08 15:07:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 15:07:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 15:07:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:07:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 15:07:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 98-138 securityworker stdout | 2021-11-08 15:07:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 15:07:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:07:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:07:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 15:07:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 15:07:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:07:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:07:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 432-464 securityworker stdout | 2021-11-08 15:07:47,836 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:07:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 15:07:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 15:07:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 15:07:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 307-347 securityworker stdout | 2021-11-08 15:07:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 19-59 securityworker stdout | 2021-11-08 15:07:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 347-387 securityworker stdout | 2021-11-08 15:07:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 15:07:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 294-334 securityworker stdout | 2021-11-08 15:07:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 15:07:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 15:07:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 15:07:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:07:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 15:07:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 15:07:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:07:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 15:07:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 15:07:47,874 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:07:47,879 [102] [INFO] [util.migrate.allocator] Found 28 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:07:48 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.041 406 0.040) gunicorn-web stdout | 2021-11-08 15:07:48,571 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:07:48 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" notificationworker stdout | 2021-11-08 15:07:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:00 UTC)" (scheduled at 2021-11-08 15:07:50.322052+00:00) notificationworker stdout | 2021-11-08 15:07:50,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:07:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:50 UTC)" (scheduled at 2021-11-08 15:07:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:07:50,421 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:07:51,795 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:21 UTC)" (scheduled at 2021-11-08 15:07:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:07:51,809 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:07:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:12:52 UTC)" (scheduled at 2021-11-08 15:07:52.376404+00:00) notificationworker stdout | 2021-11-08 15:07:52,397 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:12:52 UTC)" executed successfully gcworker stdout | 2021-11-08 15:07:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:22 UTC)" (scheduled at 2021-11-08 15:07:52.617060+00:00) gcworker stdout | 2021-11-08 15:07:52,711 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:22 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:07:53 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 15:07:53,495 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:07:53 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:07:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:54 UTC)" (scheduled at 2021-11-08 15:07:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:07:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:54 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:07:54 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:07:54,931 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:07:54 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:07:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:55 UTC)" (scheduled at 2021-11-08 15:07:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:07:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:08:55 UTC)" executed successfully securityworker stdout | 2021-11-08 15:07:58,766 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:07:58,766 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:07:58,767 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:08:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:10 UTC)" (scheduled at 2021-11-08 15:08:00.322052+00:00) notificationworker stdout | 2021-11-08 15:08:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:02 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.021 485 0.020) gunicorn-web stdout | 2021-11-08 15:08:02,336 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:02 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:02 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.026 383 0.025) gunicorn-web stdout | 2021-11-08 15:08:02,341 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:02 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" exportactionlogsworker stdout | 2021-11-08 15:08:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:06 UTC)" (scheduled at 2021-11-08 15:08:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:08:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:08:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:09 UTC)" (scheduled at 2021-11-08 15:08:09.376681+00:00) notificationworker stdout | 2021-11-08 15:08:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:08:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:20 UTC)" (scheduled at 2021-11-08 15:08:10.322052+00:00) notificationworker stdout | 2021-11-08 15:08:10,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:12 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.043 407 0.043) gunicorn-web stdout | 2021-11-08 15:08:12,361 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:12 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" repositorygcworker stdout | 2021-11-08 15:08:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:13:14 UTC)" (scheduled at 2021-11-08 15:08:14.905355+00:00) repositorygcworker stdout | 2021-11-08 15:08:14,923 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:13:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:08:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:16 UTC)" (scheduled at 2021-11-08 15:08:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:08:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:08:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:47 UTC)" (scheduled at 2021-11-08 15:08:17.787050+00:00) securityworker stdout | 2021-11-08 15:08:17,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:08:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 15:08:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 15:08:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 15:08:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 15:08:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 15:08:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:08:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 152-192 securityworker stdout | 2021-11-08 15:08:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 15:08:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 15:08:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 15:08:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 15:08:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 446-464 securityworker stdout | 2021-11-08 15:08:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 15:08:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 15:08:17,859 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:08:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 15:08:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:08:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:08:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 193-233 securityworker stdout | 2021-11-08 15:08:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:08:17,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 146-186 securityworker stdout | 2021-11-08 15:08:17,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 186-226 securityworker stdout | 2021-11-08 15:08:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:08:17,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 15:08:17,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 15:08:17,919 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:08:17,921 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 15:08:17,924 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 15:08:17,926 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 15:08:17,928 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 15:08:17,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 15:08:17,932 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:08:17,934 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:08:17,968 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 392-432 securityworker stdout | 2021-11-08 15:08:17,968 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:08:17,976 [102] [INFO] [util.migrate.allocator] Found 39 candidates, processing block notificationworker stdout | 2021-11-08 15:08:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:30 UTC)" (scheduled at 2021-11-08 15:08:20.322052+00:00) notificationworker stdout | 2021-11-08 15:08:20,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:30 UTC)" executed successfully securityworker stdout | 2021-11-08 15:08:21,124 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:08:21,125 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:08:21,125 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:47 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 15:08:21,613 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:21 +0000] "GET /repository/finacle10225/fincore_cbc?tab=tags HTTP/1.0" 200 81214 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:21 +0000] "GET /repository/finacle10225/fincore_cbc?tab=tags HTTP/2.0" 200 12916 "-" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.008 559 0.007) buildlogsarchiver stdout | 2021-11-08 15:08:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:51 UTC)" (scheduled at 2021-11-08 15:08:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:08:21,824 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:51 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/user/ HTTP/2.0" 200 1442 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.051 433 0.051) gunicorn-web stdout | 2021-11-08 15:08:22,355 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/user/ HTTP/1.0" 200 1442 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/messages HTTP/2.0" 200 17 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.031 32 0.030) gunicorn-web stdout | 2021-11-08 15:08:22,380 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/messages HTTP/1.0" 200 17 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-web stdout | 2021-11-08 15:08:22,490 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/tag/?limit=100&page=1&onlyActiveTags=true HTTP/1.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/tag/?limit=100&page=1&onlyActiveTags=true HTTP/2.0" 200 1843 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.042 426 0.042) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc?includeStats=true&includeTags=false HTTP/2.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.045 77 0.045) gunicorn-web stdout | 2021-11-08 15:08:22,493 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc?includeStats=true&includeTags=false HTTP/1.0" 200 3636 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/2.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.018 47 0.018) gunicorn-web stdout | 2021-11-08 15:08:22,526 [213] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/user/apptoken?expiring=true HTTP/1.0" 200 38 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/user/notifications HTTP/2.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.024 39 0.024) gunicorn-web stdout | 2021-11-08 15:08:22,530 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:22 +0000] "GET /api/v1/user/notifications HTTP/1.0" 200 43 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gcworker stdout | 2021-11-08 15:08:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:52 UTC)" (scheduled at 2021-11-08 15:08:22.617060+00:00) gcworker stdout | 2021-11-08 15:08:22,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:08:52 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 15:08:23,279 [217] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:23 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:513113d7196ee0f843dd54d91f1ca8d1438986fa67fa06e9514ca10ee9ce2753/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:23 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:513113d7196ee0f843dd54d91f1ca8d1438986fa67fa06e9514ca10ee9ce2753/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.065 129 0.065) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:23 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:ee7592999fa5639d5a3a765b9f0d8c22b5af36be1b477b7ae6bcdba60b7b3c5f/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.069 130 0.069) gunicorn-web stdout | 2021-11-08 15:08:23,284 [218] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:23 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:ee7592999fa5639d5a3a765b9f0d8c22b5af36be1b477b7ae6bcdba60b7b3c5f/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:23 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:6913e319ab201ccb2e5eb60a5928927d2a8327a938d21e73c1423ca92582bfff/security?vulnerabilities=true HTTP/2.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.070 129 0.070) gunicorn-web stdout | 2021-11-08 15:08:23,288 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:23 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:6913e319ab201ccb2e5eb60a5928927d2a8327a938d21e73c1423ca92582bfff/security?vulnerabilities=true HTTP/1.0" 200 204 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:23 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.049 407 0.048) gunicorn-web stdout | 2021-11-08 15:08:23,392 [219] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:23 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" gunicorn-registry stdout | 2021-11-08 15:08:24,643 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:24 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:24 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.003) gunicorn-web stdout | 2021-11-08 15:08:25,315 [216] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:25 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:a466d1a9e3ccaf1378212c87ef24728fac21ef7cf2b54b6e53cb686aaf2a973f/security?vulnerabilities=true HTTP/1.0" 200 863301 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:25 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/manifest/sha256:a466d1a9e3ccaf1378212c87ef24728fac21ef7cf2b54b6e53cb686aaf2a973f/security?vulnerabilities=true HTTP/2.0" 200 863301 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (2.164 129 2.100) namespacegcworker stdout | 2021-11-08 15:08:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:27 UTC)" (scheduled at 2021-11-08 15:08:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:08:27,898 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:08:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:40 UTC)" (scheduled at 2021-11-08 15:08:30.322052+00:00) notificationworker stdout | 2021-11-08 15:08:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:37 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:08:37,592 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:37 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:08:40,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:50 UTC)" (scheduled at 2021-11-08 15:08:40.322052+00:00) notificationworker stdout | 2021-11-08 15:08:40,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:08:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:08:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:08:42,484 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:08:42 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:08:44 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.304 325 0.304) gunicorn-registry stdout | 2021-11-08 15:08:44,983 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:08:44 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 15:08:46,621 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:08:46 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:08:46 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.166 325 0.165) securityworker stdout | 2021-11-08 15:08:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:17 UTC)" (scheduled at 2021-11-08 15:08:47.787050+00:00) securityworker stdout | 2021-11-08 15:08:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:08:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:08:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:08:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 15:08:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:08:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 15:08:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 15:08:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 15:08:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 15:08:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 451-464 securityworker stdout | 2021-11-08 15:08:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 15:08:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 98-138 securityworker stdout | 2021-11-08 15:08:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 15:08:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 15:08:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 15:08:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 15:08:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 15:08:47,860 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:08:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 15:08:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 15:08:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 15:08:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 15:08:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 12-52 securityworker stdout | 2021-11-08 15:08:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:08:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 52-92 securityworker stdout | 2021-11-08 15:08:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:08:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:08:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 250-290 securityworker stdout | 2021-11-08 15:08:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:08:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 15:08:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 15:08:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 15:08:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 358-398 securityworker stdout | 2021-11-08 15:08:47,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 436-464 securityworker stdout | 2021-11-08 15:08:47,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 15:08:47,909 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:08:47,920 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:08:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:00 UTC)" (scheduled at 2021-11-08 15:08:50.322052+00:00) notificationworker stdout | 2021-11-08 15:08:50,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:08:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:50 UTC)" (scheduled at 2021-11-08 15:08:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:08:50,411 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:08:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:21 UTC)" (scheduled at 2021-11-08 15:08:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:08:51,812 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:08:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:22 UTC)" (scheduled at 2021-11-08 15:08:52.617060+00:00) gcworker stdout | 2021-11-08 15:08:52,631 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:08:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:54 UTC)" (scheduled at 2021-11-08 15:08:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:08:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:08:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:55 UTC)" (scheduled at 2021-11-08 15:08:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:08:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:09:55 UTC)" executed successfully securityworker stdout | 2021-11-08 15:08:55,209 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:08:55,209 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:08:55,210 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:09:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:10 UTC)" (scheduled at 2021-11-08 15:09:00.322052+00:00) notificationworker stdout | 2021-11-08 15:09:00,394 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:09:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:06 UTC)" (scheduled at 2021-11-08 15:09:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:09:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:09:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:09 UTC)" (scheduled at 2021-11-08 15:09:09.376681+00:00) notificationworker stdout | 2021-11-08 15:09:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:09:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:20 UTC)" (scheduled at 2021-11-08 15:09:10.322052+00:00) notificationworker stdout | 2021-11-08 15:09:10,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:09:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:16 UTC)" (scheduled at 2021-11-08 15:09:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:09:16,907 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:09:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:47 UTC)" (scheduled at 2021-11-08 15:09:17.787050+00:00) securityworker stdout | 2021-11-08 15:09:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 15:09:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 15:09:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 15:09:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 15:09:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 15:09:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 15:09:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 15:09:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 15:09:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 15:09:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 15:09:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:09:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:09:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 15:09:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:09:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 15:09:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 430-464 securityworker stdout | 2021-11-08 15:09:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 15:09:17,850 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:09:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 15:09:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 15:09:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:09:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 15:09:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 148-188 securityworker stdout | 2021-11-08 15:09:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 15:09:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 15:09:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 15:09:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 15:09:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:09:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 15:09:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 31-71 securityworker stdout | 2021-11-08 15:09:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:09:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 15:09:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:09:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 15:09:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 15:09:17,889 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:09:17,898 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:09:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:30 UTC)" (scheduled at 2021-11-08 15:09:20.322052+00:00) notificationworker stdout | 2021-11-08 15:09:20,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:09:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:51 UTC)" (scheduled at 2021-11-08 15:09:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:09:21,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:09:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:52 UTC)" (scheduled at 2021-11-08 15:09:22.617060+00:00) gcworker stdout | 2021-11-08 15:09:22,638 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:52 UTC)" executed successfully gunicorn-web stdout | 2021-11-08 15:09:22,790 [215] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:09:22 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:09:22 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.051 406 0.051) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:09:24 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/2.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" (0.045 824 0.045) gunicorn-web stdout | 2021-11-08 15:09:24,357 [221] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:09:24 +0000] "GET /api/v1/repository/finacle10225/fincore_cbc/build/?limit=3 HTTP/1.0" 200 15 "https://enterprisequay.rblbank.com/repository/finacle10225/fincore_cbc?tab=tags" "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/95.0.4638.69 Safari/537.36" securityworker stdout | 2021-11-08 15:09:25,861 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:09:25,861 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:09:25,862 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:09:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:09:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:27 UTC)" (scheduled at 2021-11-08 15:09:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:09:27,902 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:09:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:40 UTC)" (scheduled at 2021-11-08 15:09:30.322052+00:00) notificationworker stdout | 2021-11-08 15:09:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:09:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:50 UTC)" (scheduled at 2021-11-08 15:09:40.322052+00:00) notificationworker stdout | 2021-11-08 15:09:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:09:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:09:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:17 UTC)" (scheduled at 2021-11-08 15:09:47.787050+00:00) securityworker stdout | 2021-11-08 15:09:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 15:09:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 15-55 securityworker stdout | 2021-11-08 15:09:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 15:09:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:09:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:09:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 15:09:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 15:09:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 15:09:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:09:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 15:09:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:09:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 260-300 securityworker stdout | 2021-11-08 15:09:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 15:09:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 15:09:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 460-464 securityworker stdout | 2021-11-08 15:09:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 15:09:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 15:09:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 15:09:47,849 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:09:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 15:09:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 15:09:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 15:09:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 15:09:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 15:09:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 15:09:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 15:09:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:09:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 15:09:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:09:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:09:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 15:09:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:09:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 387-427 securityworker stdout | 2021-11-08 15:09:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 15:09:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 427-464 securityworker stdout | 2021-11-08 15:09:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 383-423 securityworker stdout | 2021-11-08 15:09:47,884 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:09:47,891 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:09:48,959 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:09:48,959 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:09:48,960 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:09:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:00 UTC)" (scheduled at 2021-11-08 15:09:50.322052+00:00) notificationworker stdout | 2021-11-08 15:09:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:09:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:50 UTC)" (scheduled at 2021-11-08 15:09:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:09:50,413 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:09:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:21 UTC)" (scheduled at 2021-11-08 15:09:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:09:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:09:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:22 UTC)" (scheduled at 2021-11-08 15:09:52.617060+00:00) gcworker stdout | 2021-11-08 15:09:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:09:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:54 UTC)" (scheduled at 2021-11-08 15:09:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:09:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:09:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:55 UTC)" (scheduled at 2021-11-08 15:09:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:09:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:10:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:10:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:10 UTC)" (scheduled at 2021-11-08 15:10:00.322052+00:00) notificationworker stdout | 2021-11-08 15:10:00,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:10:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:06 UTC)" (scheduled at 2021-11-08 15:10:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:10:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:10:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:09 UTC)" (scheduled at 2021-11-08 15:10:09.376681+00:00) notificationworker stdout | 2021-11-08 15:10:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:10:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:20 UTC)" (scheduled at 2021-11-08 15:10:10.322052+00:00) notificationworker stdout | 2021-11-08 15:10:10,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:10:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:16 UTC)" (scheduled at 2021-11-08 15:10:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:10:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:10:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:47 UTC)" (scheduled at 2021-11-08 15:10:17.787050+00:00) securityworker stdout | 2021-11-08 15:10:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 15:10:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 15:10:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 15:10:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 15:10:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 15:10:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 15:10:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 15:10:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:10:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 15:10:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 15:10:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:10:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 15:10:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 15:10:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:10:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 15:10:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 15:10:17,855 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:10:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 15:10:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 15:10:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 15:10:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 237-277 securityworker stdout | 2021-11-08 15:10:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 15:10:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 15:10:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:10:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:10:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 23-63 securityworker stdout | 2021-11-08 15:10:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:10:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 15:10:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:10:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 15:10:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 15:10:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:10:17,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 15:10:17,902 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:10:17,912 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:10:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:30 UTC)" (scheduled at 2021-11-08 15:10:20.322052+00:00) notificationworker stdout | 2021-11-08 15:10:20,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:30 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:10:21,726 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:10:21 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:10:21 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.089 325 0.088) buildlogsarchiver stdout | 2021-11-08 15:10:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:51 UTC)" (scheduled at 2021-11-08 15:10:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:10:21,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:10:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:52 UTC)" (scheduled at 2021-11-08 15:10:22.617060+00:00) gcworker stdout | 2021-11-08 15:10:22,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:52 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:10:24,520 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:10:24 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:10:24 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.184 325 0.183) securityworker stdout | 2021-11-08 15:10:27,503 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:10:27,503 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:10:27,504 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:10:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:10:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:27 UTC)" (scheduled at 2021-11-08 15:10:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:10:27,915 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:10:30,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:40 UTC)" (scheduled at 2021-11-08 15:10:30.322052+00:00) notificationworker stdout | 2021-11-08 15:10:30,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:10:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:50 UTC)" (scheduled at 2021-11-08 15:10:40.322052+00:00) notificationworker stdout | 2021-11-08 15:10:40,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:10:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:10:42,737 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:10:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:10:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.246 325 0.246) securityworker stdout | 2021-11-08 15:10:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:17 UTC)" (scheduled at 2021-11-08 15:10:47.787050+00:00) securityworker stdout | 2021-11-08 15:10:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 15:10:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 15:10:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:10:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 336-376 securityworker stdout | 2021-11-08 15:10:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 15:10:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 277-317 securityworker stdout | 2021-11-08 15:10:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 15:10:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 15:10:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:10:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 15:10:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 15:10:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:10:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 15:10:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 15:10:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 15:10:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 15:10:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:10:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 15:10:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 15:10:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:10:47,869 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:10:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 15:10:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 15:10:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 15:10:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 15:10:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 15:10:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 15:10:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 15:10:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:10:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:10:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 15:10:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 15:10:47,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 15:10:47,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 15:10:47,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 15:10:47,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 381-421 securityworker stdout | 2021-11-08 15:10:47,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:10:47,921 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 15:10:47,923 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 15:10:47,923 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:10:47,931 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 15:10:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:15:49 UTC)" (scheduled at 2021-11-08 15:10:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 15:10:49,456 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:15:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:10:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:00 UTC)" (scheduled at 2021-11-08 15:10:50.322052+00:00) notificationworker stdout | 2021-11-08 15:10:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:10:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:50 UTC)" (scheduled at 2021-11-08 15:10:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:10:50,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:10:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:21 UTC)" (scheduled at 2021-11-08 15:10:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:10:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:10:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:22 UTC)" (scheduled at 2021-11-08 15:10:52.617060+00:00) gcworker stdout | 2021-11-08 15:10:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:10:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:54 UTC)" (scheduled at 2021-11-08 15:10:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:10:54,191 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:54 UTC)" executed successfully securityworker stdout | 2021-11-08 15:10:54,611 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:10:54,611 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:10:54,612 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:17 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:10:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:55 UTC)" (scheduled at 2021-11-08 15:10:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:10:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:11:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:11:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:10 UTC)" (scheduled at 2021-11-08 15:11:00.322052+00:00) notificationworker stdout | 2021-11-08 15:11:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:11:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:06 UTC)" (scheduled at 2021-11-08 15:11:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:11:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:06 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:11:06,610 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:11:06 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:11:06 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.090 325 0.090) notificationworker stdout | 2021-11-08 15:11:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:09 UTC)" (scheduled at 2021-11-08 15:11:09.376681+00:00) notificationworker stdout | 2021-11-08 15:11:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:11:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:20 UTC)" (scheduled at 2021-11-08 15:11:10.322052+00:00) notificationworker stdout | 2021-11-08 15:11:10,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:11:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:16 UTC)" (scheduled at 2021-11-08 15:11:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:11:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:11:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:47 UTC)" (scheduled at 2021-11-08 15:11:17.787050+00:00) securityworker stdout | 2021-11-08 15:11:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 15:11:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:11:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 15:11:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 15:11:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 15:11:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 15:11:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 15:11:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 15:11:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 15:11:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 15:11:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 15:11:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:11:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:11:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 15:11:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 15:11:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 15:11:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 15:11:17,867 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:11:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 15:11:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 15:11:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:11:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 25-65 securityworker stdout | 2021-11-08 15:11:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 309-349 securityworker stdout | 2021-11-08 15:11:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:11:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 15:11:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:11:17,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:11:17,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 15:11:17,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:11:17,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 15:11:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 15:11:17,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 15:11:17,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:11:17,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 15:11:17,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:11:17,922 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:11:17,930 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:11:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:30 UTC)" (scheduled at 2021-11-08 15:11:20.322052+00:00) notificationworker stdout | 2021-11-08 15:11:20,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:11:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:51 UTC)" (scheduled at 2021-11-08 15:11:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:11:21,827 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:11:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:52 UTC)" (scheduled at 2021-11-08 15:11:22.617060+00:00) gcworker stdout | 2021-11-08 15:11:22,639 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:52 UTC)" executed successfully securityworker stdout | 2021-11-08 15:11:27,088 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:11:27,088 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:11:27,089 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:11:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:11:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:27 UTC)" (scheduled at 2021-11-08 15:11:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:11:27,897 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:11:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:40 UTC)" (scheduled at 2021-11-08 15:11:30.322052+00:00) notificationworker stdout | 2021-11-08 15:11:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:40 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:11:32,611 [235] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:11:32 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:11:32 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.090 325 0.090) notificationworker stdout | 2021-11-08 15:11:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:50 UTC)" (scheduled at 2021-11-08 15:11:40.322052+00:00) notificationworker stdout | 2021-11-08 15:11:40,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:11:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:11:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:17 UTC)" (scheduled at 2021-11-08 15:11:47.787050+00:00) securityworker stdout | 2021-11-08 15:11:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 15:11:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 15:11:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 15:11:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 15:11:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 15:11:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 15:11:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:11:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:11:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:11:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 435-464 securityworker stdout | 2021-11-08 15:11:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 15:11:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 15:11:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 15:11:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 15:11:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 15:11:47,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 379-419 securityworker stdout | 2021-11-08 15:11:47,908 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:11:47,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 15:11:47,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:11:47,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 15:11:47,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 15:11:47,923 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 15:11:47,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 15:11:47,928 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 15:11:47,931 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 15:11:47,933 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 15:11:47,936 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 15:11:47,938 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:11:47,941 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 15:11:47,943 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:11:47,946 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:11:47,948 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 15:11:47,951 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 15:11:47,951 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:11:47,959 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:11:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:00 UTC)" (scheduled at 2021-11-08 15:11:50.322052+00:00) notificationworker stdout | 2021-11-08 15:11:50,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:11:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:50 UTC)" (scheduled at 2021-11-08 15:11:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:11:50,412 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:11:50,901 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:11:50,902 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:11:50,903 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:11:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:21 UTC)" (scheduled at 2021-11-08 15:11:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:11:51,809 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:11:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:22 UTC)" (scheduled at 2021-11-08 15:11:52.617060+00:00) gcworker stdout | 2021-11-08 15:11:52,638 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:11:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:54 UTC)" (scheduled at 2021-11-08 15:11:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:11:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:11:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:55 UTC)" (scheduled at 2021-11-08 15:11:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:11:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:12:55 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:11:56,353 [245] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} gunicorn-registry stdout | 2021-11-08 15:11:56,355 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:11:56 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:11:56 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.003) notificationworker stdout | 2021-11-08 15:12:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:10 UTC)" (scheduled at 2021-11-08 15:12:00.322052+00:00) notificationworker stdout | 2021-11-08 15:12:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:12:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:06 UTC)" (scheduled at 2021-11-08 15:12:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:12:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:12:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:09 UTC)" (scheduled at 2021-11-08 15:12:09.376681+00:00) notificationworker stdout | 2021-11-08 15:12:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:12:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:20 UTC)" (scheduled at 2021-11-08 15:12:10.322052+00:00) notificationworker stdout | 2021-11-08 15:12:10,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:12:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:16 UTC)" (scheduled at 2021-11-08 15:12:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:12:16,907 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:12:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:47 UTC)" (scheduled at 2021-11-08 15:12:17.787050+00:00) securityworker stdout | 2021-11-08 15:12:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 15:12:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 15:12:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 232-272 securityworker stdout | 2021-11-08 15:12:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 272-312 securityworker stdout | 2021-11-08 15:12:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 15:12:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 15:12:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 34-74 securityworker stdout | 2021-11-08 15:12:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 15:12:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 15:12:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 15:12:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 15:12:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:12:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 15:12:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 392-432 securityworker stdout | 2021-11-08 15:12:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 15:12:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 446-464 securityworker stdout | 2021-11-08 15:12:17,859 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:12:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 15:12:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 15:12:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 15:12:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 15:12:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 15:12:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:12:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 securityworker stdout | 2021-11-08 15:12:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 15:12:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 215-255 securityworker stdout | 2021-11-08 15:12:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 15:12:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 15:12:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 15:12:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 15:12:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 441-464 securityworker stdout | 2021-11-08 15:12:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 15:12:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 15:12:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 15:12:17,901 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:12:17,911 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:12:19,392 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:12:19,392 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:12:19,393 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:12:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:30 UTC)" (scheduled at 2021-11-08 15:12:20.322052+00:00) notificationworker stdout | 2021-11-08 15:12:20,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:12:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:51 UTC)" (scheduled at 2021-11-08 15:12:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:12:21,809 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:12:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:52 UTC)" (scheduled at 2021-11-08 15:12:22.617060+00:00) gcworker stdout | 2021-11-08 15:12:22,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:12:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:12:26 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.022 1689 0.022) gunicorn-registry stdout | 2021-11-08 15:12:26,652 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:12:26 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:12:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:27 UTC)" (scheduled at 2021-11-08 15:12:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:12:27,898 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:12:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:40 UTC)" (scheduled at 2021-11-08 15:12:30.322052+00:00) notificationworker stdout | 2021-11-08 15:12:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:12:32 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.018 1690 0.018) gunicorn-registry stdout | 2021-11-08 15:12:32,573 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:12:32 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:12:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:50 UTC)" (scheduled at 2021-11-08 15:12:40.322052+00:00) notificationworker stdout | 2021-11-08 15:12:40,352 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:12:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:12:41 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.015) gunicorn-registry stdout | 2021-11-08 15:12:41,769 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:12:41 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:12:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:17:46 UTC)" (scheduled at 2021-11-08 15:12:46.131205+00:00) namespacegcworker stdout | 2021-11-08 15:12:46,148 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:17:46 UTC)" executed successfully securityworker stdout | 2021-11-08 15:12:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:17 UTC)" (scheduled at 2021-11-08 15:12:47.787050+00:00) securityworker stdout | 2021-11-08 15:12:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 335-375 securityworker stdout | 2021-11-08 15:12:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 31-71 securityworker stdout | 2021-11-08 15:12:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:12:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 15:12:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:12:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 15:12:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:12:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 15:12:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 15:12:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 15:12:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 15:12:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:12:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:12:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 375-415 securityworker stdout | 2021-11-08 15:12:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 15:12:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 15:12:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:12:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 15:12:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 15:12:47,859 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:12:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:12:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 15:12:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 15:12:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 15:12:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 15:12:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 15:12:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 15:12:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:12:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 15:12:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:12:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 10-50 securityworker stdout | 2021-11-08 15:12:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 15:12:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:12:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:12:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 358-398 securityworker stdout | 2021-11-08 15:12:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 15:12:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 15:12:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 398-438 securityworker stdout | 2021-11-08 15:12:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 15:12:47,900 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:12:47,910 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:12:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:00 UTC)" (scheduled at 2021-11-08 15:12:50.322052+00:00) notificationworker stdout | 2021-11-08 15:12:50,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:12:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:50 UTC)" (scheduled at 2021-11-08 15:12:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:12:50,409 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:12:51,506 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:12:51,506 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:12:51,507 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:12:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:21 UTC)" (scheduled at 2021-11-08 15:12:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:12:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:12:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:17:52 UTC)" (scheduled at 2021-11-08 15:12:52.376404+00:00) notificationworker stdout | 2021-11-08 15:12:52,403 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:17:52 UTC)" executed successfully gcworker stdout | 2021-11-08 15:12:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:22 UTC)" (scheduled at 2021-11-08 15:12:52.617060+00:00) gcworker stdout | 2021-11-08 15:12:52,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:12:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:54 UTC)" (scheduled at 2021-11-08 15:12:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:12:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:12:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:55 UTC)" (scheduled at 2021-11-08 15:12:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:12:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:13:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:12:59 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.014) gunicorn-registry stdout | 2021-11-08 15:12:59,423 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:12:59 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:13:00 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1691 0.014) gunicorn-registry stdout | 2021-11-08 15:13:00,079 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:13:00 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:13:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:10 UTC)" (scheduled at 2021-11-08 15:13:00.322052+00:00) notificationworker stdout | 2021-11-08 15:13:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:13:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:06 UTC)" (scheduled at 2021-11-08 15:13:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:13:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:06 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:13:06 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) gunicorn-registry stdout | 2021-11-08 15:13:06,644 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:13:06 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:13:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:09 UTC)" (scheduled at 2021-11-08 15:13:09.376681+00:00) notificationworker stdout | 2021-11-08 15:13:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:13:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:20 UTC)" (scheduled at 2021-11-08 15:13:10.322052+00:00) notificationworker stdout | 2021-11-08 15:13:10,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:13:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:18:14 UTC)" (scheduled at 2021-11-08 15:13:14.905355+00:00) repositorygcworker stdout | 2021-11-08 15:13:14,921 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:18:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:13:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:16 UTC)" (scheduled at 2021-11-08 15:13:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:13:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:13:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:47 UTC)" (scheduled at 2021-11-08 15:13:17.787050+00:00) securityworker stdout | 2021-11-08 15:13:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:13:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 15:13:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 15:13:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 15:13:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 15:13:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 15:13:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 15:13:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 15:13:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 15:13:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 294-334 securityworker stdout | 2021-11-08 15:13:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:13:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:13:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 15:13:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:13:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:13:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 439-464 securityworker stdout | 2021-11-08 15:13:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 15:13:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:13:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 15:13:17,877 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:13:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 15:13:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 15:13:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:13:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 15:13:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 9-49 securityworker stdout | 2021-11-08 15:13:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 15:13:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 15:13:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 15:13:17,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 15:13:17,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 15:13:17,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:13:17,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:13:17,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:13:17,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 15:13:17,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:13:17,921 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 15:13:17,924 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:13:17,926 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 445-464 securityworker stdout | 2021-11-08 15:13:17,926 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:13:17,936 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:13:19,368 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:13:19,368 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:13:19,369 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:13:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:30 UTC)" (scheduled at 2021-11-08 15:13:20.322052+00:00) notificationworker stdout | 2021-11-08 15:13:20,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:13:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:51 UTC)" (scheduled at 2021-11-08 15:13:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:13:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:13:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:52 UTC)" (scheduled at 2021-11-08 15:13:22.617060+00:00) gcworker stdout | 2021-11-08 15:13:22,636 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:13:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:13:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:27 UTC)" (scheduled at 2021-11-08 15:13:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:13:27,897 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:13:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:40 UTC)" (scheduled at 2021-11-08 15:13:30.322052+00:00) notificationworker stdout | 2021-11-08 15:13:30,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:13:34 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1690 0.019) gunicorn-registry stdout | 2021-11-08 15:13:34,778 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:13:34 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:13:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:50 UTC)" (scheduled at 2021-11-08 15:13:40.322052+00:00) notificationworker stdout | 2021-11-08 15:13:40,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:13:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:13:45 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.018 1690 0.018) gunicorn-registry stdout | 2021-11-08 15:13:45,662 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:13:45 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 15:13:47,651 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:13:47 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:13:47 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.020 1690 0.019) securityworker stdout | 2021-11-08 15:13:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:17 UTC)" (scheduled at 2021-11-08 15:13:47.787050+00:00) securityworker stdout | 2021-11-08 15:13:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 15:13:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 15:13:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 391-431 securityworker stdout | 2021-11-08 15:13:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 15:13:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 30-70 securityworker stdout | 2021-11-08 15:13:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:13:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 15:13:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 15:13:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 15:13:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:13:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 15:13:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 15:13:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:13:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 320-360 securityworker stdout | 2021-11-08 15:13:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 434-464 securityworker stdout | 2021-11-08 15:13:47,852 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:13:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 15:13:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 30-70 securityworker stdout | 2021-11-08 15:13:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:13:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:13:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 15:13:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 250-290 securityworker stdout | 2021-11-08 15:13:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 15:13:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:13:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 15:13:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 15:13:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 15:13:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 15:13:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 15:13:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:13:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 15:13:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 15:13:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 15:13:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 15:13:47,898 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:13:47,906 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:13:49,347 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:13:49,347 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:13:49,348 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:17 UTC)" executed successfully servicekey stdout | 2021-11-08 15:13:50,142 [103] [INFO] [apscheduler.executors.default] Running job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2021-11-08 16:08:50 UTC)" (scheduled at 2021-11-08 15:13:50.141249+00:00) servicekey stdout | 2021-11-08 15:13:50,159 [103] [INFO] [apscheduler.executors.default] Job "ServiceKeyWorker._refresh_service_key (trigger: interval[0:55:00], next run at: 2021-11-08 16:08:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:13:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:00 UTC)" (scheduled at 2021-11-08 15:13:50.322052+00:00) notificationworker stdout | 2021-11-08 15:13:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:13:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:50 UTC)" (scheduled at 2021-11-08 15:13:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:13:50,410 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:13:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:21 UTC)" (scheduled at 2021-11-08 15:13:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:13:51,812 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:13:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:22 UTC)" (scheduled at 2021-11-08 15:13:52.617060+00:00) gcworker stdout | 2021-11-08 15:13:52,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:13:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:54 UTC)" (scheduled at 2021-11-08 15:13:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:13:54,185 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:13:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:55 UTC)" (scheduled at 2021-11-08 15:13:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:13:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:14:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:13:57 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:13:57,384 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:13:57 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:14:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:10 UTC)" (scheduled at 2021-11-08 15:14:00.322052+00:00) notificationworker stdout | 2021-11-08 15:14:00,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:14:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:06 UTC)" (scheduled at 2021-11-08 15:14:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:14:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:14:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:09 UTC)" (scheduled at 2021-11-08 15:14:09.376681+00:00) notificationworker stdout | 2021-11-08 15:14:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:14:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:20 UTC)" (scheduled at 2021-11-08 15:14:10.322052+00:00) notificationworker stdout | 2021-11-08 15:14:10,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:14:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:16 UTC)" (scheduled at 2021-11-08 15:14:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:14:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:14:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:47 UTC)" (scheduled at 2021-11-08 15:14:17.787050+00:00) securityworker stdout | 2021-11-08 15:14:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 250-290 securityworker stdout | 2021-11-08 15:14:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 15:14:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 15:14:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 15:14:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:14:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 39-79 securityworker stdout | 2021-11-08 15:14:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:14:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:14:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 15:14:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 15:14:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 15:14:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 15:14:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 15:14:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:14:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 15:14:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 15:14:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 15:14:17,866 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:14:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:14:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 15:14:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 15:14:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:14:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:14:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 15:14:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 15:14:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 31-71 securityworker stdout | 2021-11-08 15:14:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:14:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:14:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:14:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 453-464 securityworker stdout | 2021-11-08 15:14:17,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 347-387 securityworker stdout | 2021-11-08 15:14:17,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 15:14:17,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 387-427 securityworker stdout | 2021-11-08 15:14:17,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:14:17,915 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:14:17,924 [102] [INFO] [util.migrate.allocator] Found 34 candidates, processing block securityworker stdout | 2021-11-08 15:14:19,118 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:14:19,119 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:14:19,120 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:14:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:30 UTC)" (scheduled at 2021-11-08 15:14:20.322052+00:00) notificationworker stdout | 2021-11-08 15:14:20,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:14:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:51 UTC)" (scheduled at 2021-11-08 15:14:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:14:21,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:14:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:52 UTC)" (scheduled at 2021-11-08 15:14:22.617060+00:00) gcworker stdout | 2021-11-08 15:14:22,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:14:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:14:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:27 UTC)" (scheduled at 2021-11-08 15:14:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:14:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:14:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:40 UTC)" (scheduled at 2021-11-08 15:14:30.322052+00:00) notificationworker stdout | 2021-11-08 15:14:30,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:14:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:50 UTC)" (scheduled at 2021-11-08 15:14:40.322052+00:00) notificationworker stdout | 2021-11-08 15:14:40,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:14:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:14:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:17 UTC)" (scheduled at 2021-11-08 15:14:47.787050+00:00) securityworker stdout | 2021-11-08 15:14:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 9-49 securityworker stdout | 2021-11-08 15:14:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:14:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 15:14:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:14:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 15:14:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 15:14:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 15:14:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:14:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 15:14:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 15:14:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 15:14:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:14:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 15:14:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 15:14:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:14:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 15:14:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 15:14:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 453-464 securityworker stdout | 2021-11-08 15:14:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 15:14:47,866 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:14:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 108-148 securityworker stdout | 2021-11-08 15:14:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:14:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 153-193 securityworker stdout | 2021-11-08 15:14:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:14:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 15:14:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:14:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 148-188 securityworker stdout | 2021-11-08 15:14:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:14:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 15:14:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:14:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 15:14:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 264-304 securityworker stdout | 2021-11-08 15:14:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 193-233 securityworker stdout | 2021-11-08 15:14:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:14:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 15:14:47,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:14:47,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 15:14:47,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:14:47,910 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:14:47,920 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:14:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:00 UTC)" (scheduled at 2021-11-08 15:14:50.322052+00:00) notificationworker stdout | 2021-11-08 15:14:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:14:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:50 UTC)" (scheduled at 2021-11-08 15:14:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:14:50,411 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:14:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:21 UTC)" (scheduled at 2021-11-08 15:14:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:14:51,809 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:14:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:22 UTC)" (scheduled at 2021-11-08 15:14:52.617060+00:00) gcworker stdout | 2021-11-08 15:14:52,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:14:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:54 UTC)" (scheduled at 2021-11-08 15:14:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:14:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:14:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:55 UTC)" (scheduled at 2021-11-08 15:14:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:14:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:15:55 UTC)" executed successfully securityworker stdout | 2021-11-08 15:14:58,079 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:14:58,079 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:14:58,081 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:15:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:10 UTC)" (scheduled at 2021-11-08 15:15:00.322052+00:00) notificationworker stdout | 2021-11-08 15:15:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:15:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:06 UTC)" (scheduled at 2021-11-08 15:15:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:15:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:15:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:09 UTC)" (scheduled at 2021-11-08 15:15:09.376681+00:00) notificationworker stdout | 2021-11-08 15:15:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:15:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:20 UTC)" (scheduled at 2021-11-08 15:15:10.322052+00:00) notificationworker stdout | 2021-11-08 15:15:10,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:15:16,907 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:16 UTC)" (scheduled at 2021-11-08 15:15:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:15:16,907 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:15:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:47 UTC)" (scheduled at 2021-11-08 15:15:17.787050+00:00) securityworker stdout | 2021-11-08 15:15:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 110-150 securityworker stdout | 2021-11-08 15:15:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 10-50 securityworker stdout | 2021-11-08 15:15:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:15:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 15:15:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 15:15:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 15:15:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:15:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 15:15:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 15:15:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 15:15:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 15:15:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 15:15:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:15:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 15:15:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 15:15:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 442-464 securityworker stdout | 2021-11-08 15:15:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 15:15:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:15:17,881 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:15:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 68-108 securityworker stdout | 2021-11-08 15:15:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 15:15:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:15:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 15:15:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 289-329 securityworker stdout | 2021-11-08 15:15:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 15:15:17,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:15:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:15:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 121-161 securityworker stdout | 2021-11-08 15:15:17,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 108-148 securityworker stdout | 2021-11-08 15:15:17,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 15:15:17,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:15:17,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 15:15:17,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 15:15:17,914 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 15:15:17,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 15:15:17,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 161-201 securityworker stdout | 2021-11-08 15:15:17,920 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:15:17,927 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:15:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:30 UTC)" (scheduled at 2021-11-08 15:15:20.322052+00:00) notificationworker stdout | 2021-11-08 15:15:20,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:30 UTC)" executed successfully securityworker stdout | 2021-11-08 15:15:21,785 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:15:21,785 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:15:21,786 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:15:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:51 UTC)" (scheduled at 2021-11-08 15:15:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:15:21,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:15:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:52 UTC)" (scheduled at 2021-11-08 15:15:22.617060+00:00) gcworker stdout | 2021-11-08 15:15:22,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:15:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:15:24 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:15:24,609 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:15:24 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:15:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:27 UTC)" (scheduled at 2021-11-08 15:15:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:15:27,905 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:27 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:15:27 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:15:27,924 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:15:27 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:15:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:40 UTC)" (scheduled at 2021-11-08 15:15:30.322052+00:00) notificationworker stdout | 2021-11-08 15:15:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:15:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:50 UTC)" (scheduled at 2021-11-08 15:15:40.322052+00:00) notificationworker stdout | 2021-11-08 15:15:40,353 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:15:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:15:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:17 UTC)" (scheduled at 2021-11-08 15:15:47.787050+00:00) securityworker stdout | 2021-11-08 15:15:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 15:15:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:15:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 15:15:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 15:15:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 15:15:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 15:15:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 15:15:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 15:15:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 15:15:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 307-347 securityworker stdout | 2021-11-08 15:15:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 146-186 securityworker stdout | 2021-11-08 15:15:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 26-66 securityworker stdout | 2021-11-08 15:15:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 15:15:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:15:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 15:15:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 15:15:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 15:15:47,859 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:15:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 15:15:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 15:15:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 15:15:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 15:15:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 30-70 securityworker stdout | 2021-11-08 15:15:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 15:15:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:15:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 70-110 securityworker stdout | 2021-11-08 15:15:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 15:15:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:15:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 15:15:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 433-464 securityworker stdout | 2021-11-08 15:15:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 352-392 securityworker stdout | 2021-11-08 15:15:47,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:15:47,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 392-432 securityworker stdout | 2021-11-08 15:15:47,910 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:15:47,919 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 15:15:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:20:49 UTC)" (scheduled at 2021-11-08 15:15:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 15:15:49,455 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:20:49 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:15:50 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:15:50,289 [233] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:15:50 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:15:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:00 UTC)" (scheduled at 2021-11-08 15:15:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 15:15:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:50 UTC)" (scheduled at 2021-11-08 15:15:50.393684+00:00) notificationworker stdout | 2021-11-08 15:15:50,534 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:15:50,537 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:15:51,121 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:15:51,122 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:15:51,123 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:15:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:21 UTC)" (scheduled at 2021-11-08 15:15:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:15:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:15:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:22 UTC)" (scheduled at 2021-11-08 15:15:52.617060+00:00) gcworker stdout | 2021-11-08 15:15:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:15:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:54 UTC)" (scheduled at 2021-11-08 15:15:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:15:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:15:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:55 UTC)" (scheduled at 2021-11-08 15:15:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:15:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:16:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:16:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:10 UTC)" (scheduled at 2021-11-08 15:16:00.322052+00:00) notificationworker stdout | 2021-11-08 15:16:00,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:16:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:06 UTC)" (scheduled at 2021-11-08 15:16:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:16:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:16:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:09 UTC)" (scheduled at 2021-11-08 15:16:09.376681+00:00) notificationworker stdout | 2021-11-08 15:16:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:16:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:20 UTC)" (scheduled at 2021-11-08 15:16:10.322052+00:00) notificationworker stdout | 2021-11-08 15:16:10,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:16:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:16 UTC)" (scheduled at 2021-11-08 15:16:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:16:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:16:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:47 UTC)" (scheduled at 2021-11-08 15:16:17.787050+00:00) securityworker stdout | 2021-11-08 15:16:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 15:16:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 15:16:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 15:16:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 15:16:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 15:16:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 15:16:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 15:16:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:16:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:16:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 277-317 securityworker stdout | 2021-11-08 15:16:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:16:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:16:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 15:16:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 15:16:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 15:16:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:16:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:16:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 15:16:17,847 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:16:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:16:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 213-253 securityworker stdout | 2021-11-08 15:16:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 15:16:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 15:16:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 15:16:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 15:16:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 15:16:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 15:16:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 15:16:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 158-198 securityworker stdout | 2021-11-08 15:16:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 198-238 securityworker stdout | 2021-11-08 15:16:18,042 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 15:16:18,048 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:16:18,051 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 15:16:18,052 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 18-58 securityworker stdout | 2021-11-08 15:16:18,054 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 15:16:18,056 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:16:18,058 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 15:16:18,058 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:16:18,067 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:16:19 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:16:19,497 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:16:19 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 15:16:19,877 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:16:19,877 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:16:19,878 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:16:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:30 UTC)" (scheduled at 2021-11-08 15:16:20.322052+00:00) notificationworker stdout | 2021-11-08 15:16:20,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:16:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:51 UTC)" (scheduled at 2021-11-08 15:16:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:16:21,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:16:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:52 UTC)" (scheduled at 2021-11-08 15:16:22.617060+00:00) gcworker stdout | 2021-11-08 15:16:22,636 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:16:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:16:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:27 UTC)" (scheduled at 2021-11-08 15:16:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:16:27,901 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:16:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:40 UTC)" (scheduled at 2021-11-08 15:16:30.322052+00:00) notificationworker stdout | 2021-11-08 15:16:30,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:16:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:50 UTC)" (scheduled at 2021-11-08 15:16:40.322052+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:16:40 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:16:40,495 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:16:40 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:16:40,786 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:16:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:16:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:17 UTC)" (scheduled at 2021-11-08 15:16:47.787050+00:00) securityworker stdout | 2021-11-08 15:16:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 15:16:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 276-316 securityworker stdout | 2021-11-08 15:16:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 15:16:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 15:16:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 15:16:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 15:16:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 15:16:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 15:16:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 9-49 securityworker stdout | 2021-11-08 15:16:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 15:16:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:16:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 15:16:47,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 15:16:47,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:16:47,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:16:47,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:16:47,914 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 15:16:47,914 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:16:47,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:16:48,062 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 260-300 securityworker stdout | 2021-11-08 15:16:48,065 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 15:16:48,068 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 15:16:48,070 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 15:16:48,073 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 15:16:48,075 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 15:16:48,077 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 15:16:48,080 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 343-383 securityworker stdout | 2021-11-08 15:16:48,082 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 300-340 securityworker stdout | 2021-11-08 15:16:48,085 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 15:16:48,087 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:16:48,090 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:16:48,092 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 15:16:48,095 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:16:48,097 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 15:16:48,100 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 15:16:48,102 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 15:16:48,104 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 15:16:48,104 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:16:48,112 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:16:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:00 UTC)" (scheduled at 2021-11-08 15:16:50.322052+00:00) notificationworker stdout | 2021-11-08 15:16:50,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:16:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:50 UTC)" (scheduled at 2021-11-08 15:16:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:16:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:16:50,724 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:16:50,725 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:16:50,726 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:16:51,795 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:21 UTC)" (scheduled at 2021-11-08 15:16:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:16:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:16:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:22 UTC)" (scheduled at 2021-11-08 15:16:52.617060+00:00) gcworker stdout | 2021-11-08 15:16:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:16:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:54 UTC)" (scheduled at 2021-11-08 15:16:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:16:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:16:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:55 UTC)" (scheduled at 2021-11-08 15:16:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:16:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:17:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:17:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:10 UTC)" (scheduled at 2021-11-08 15:17:00.322052+00:00) notificationworker stdout | 2021-11-08 15:17:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:17:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:17:04,335 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:17:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:17:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:06 UTC)" (scheduled at 2021-11-08 15:17:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:17:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:17:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:09 UTC)" (scheduled at 2021-11-08 15:17:09.376681+00:00) notificationworker stdout | 2021-11-08 15:17:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:17:10,324 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:20 UTC)" (scheduled at 2021-11-08 15:17:10.322052+00:00) notificationworker stdout | 2021-11-08 15:17:10,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:17:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:16 UTC)" (scheduled at 2021-11-08 15:17:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:17:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:17:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:47 UTC)" (scheduled at 2021-11-08 15:17:17.787050+00:00) securityworker stdout | 2021-11-08 15:17:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:17:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 28-68 securityworker stdout | 2021-11-08 15:17:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:17:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 68-108 securityworker stdout | 2021-11-08 15:17:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:17:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:17:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 15:17:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 15:17:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 15:17:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:17:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 15:17:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:17:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:17:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 15:17:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 15:17:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 15:17:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 15:17:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 15:17:17,848 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:17:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 34-74 securityworker stdout | 2021-11-08 15:17:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 393-433 securityworker stdout | 2021-11-08 15:17:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:17:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 433-464 securityworker stdout | 2021-11-08 15:17:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 15:17:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:17:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:17:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:17:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 15:17:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 15:17:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 15:17:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:17:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 15:17:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:17:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 15:17:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 15:17:17,895 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:17:17,901 [102] [INFO] [util.migrate.allocator] Found 10 candidates, processing block notificationworker stdout | 2021-11-08 15:17:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:30 UTC)" (scheduled at 2021-11-08 15:17:20.322052+00:00) notificationworker stdout | 2021-11-08 15:17:20,347 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:17:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:51 UTC)" (scheduled at 2021-11-08 15:17:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:17:21,809 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:51 UTC)" executed successfully securityworker stdout | 2021-11-08 15:17:21,881 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:17:21,882 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:17:21,882 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:47 UTC)" executed successfully gcworker stdout | 2021-11-08 15:17:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:52 UTC)" (scheduled at 2021-11-08 15:17:22.617060+00:00) gcworker stdout | 2021-11-08 15:17:22,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:17:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:17:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:27 UTC)" (scheduled at 2021-11-08 15:17:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:17:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:17:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:40 UTC)" (scheduled at 2021-11-08 15:17:30.322052+00:00) notificationworker stdout | 2021-11-08 15:17:30,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:17:37 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.104 325 0.104) gunicorn-registry stdout | 2021-11-08 15:17:37,628 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:17:37 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:17:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:50 UTC)" (scheduled at 2021-11-08 15:17:40.322052+00:00) notificationworker stdout | 2021-11-08 15:17:40,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:17:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:17:42,509 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:17:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:17:42 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.103 325 0.103) manifestbackfillworker stdout | 2021-11-08 15:17:44,035 [76] [INFO] [apscheduler.executors.default] Running job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2021-11-08 16:17:44 UTC)" (scheduled at 2021-11-08 15:17:44.032264+00:00) manifestbackfillworker stdout | 2021-11-08 15:17:44,052 [76] [INFO] [apscheduler.executors.default] Job "ManifestBackfillWorker._backfill_manifests (trigger: interval[1:00:00], next run at: 2021-11-08 16:17:44 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:17:46,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:22:46 UTC)" (scheduled at 2021-11-08 15:17:46.131205+00:00) namespacegcworker stdout | 2021-11-08 15:17:46,153 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:22:46 UTC)" executed successfully securityworker stdout | 2021-11-08 15:17:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:17 UTC)" (scheduled at 2021-11-08 15:17:47.787050+00:00) securityworker stdout | 2021-11-08 15:17:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 149-189 securityworker stdout | 2021-11-08 15:17:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 15:17:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 15:17:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 15:17:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:17:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 15:17:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 15:17:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:17:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 15:17:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 442-464 securityworker stdout | 2021-11-08 15:17:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 15:17:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 189-229 securityworker stdout | 2021-11-08 15:17:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:17:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 15:17:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 15:17:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 237-277 securityworker stdout | 2021-11-08 15:17:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 15:17:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 15:17:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 15:17:47,856 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:17:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 15:17:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 15:17:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 15:17:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 12-52 securityworker stdout | 2021-11-08 15:17:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 15:17:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:17:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 133-173 securityworker stdout | 2021-11-08 15:17:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 74-114 securityworker stdout | 2021-11-08 15:17:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 15:17:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 173-213 securityworker stdout | 2021-11-08 15:17:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:17:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 15:17:47,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 15:17:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:17:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 52-92 securityworker stdout | 2021-11-08 15:17:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 15:17:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 15:17:47,897 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:17:47,905 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 15:17:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:00 UTC)" (scheduled at 2021-11-08 15:17:50.322052+00:00) notificationworker stdout | 2021-11-08 15:17:50,348 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:17:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:50 UTC)" (scheduled at 2021-11-08 15:17:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:17:50,420 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:17:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:21 UTC)" (scheduled at 2021-11-08 15:17:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:17:51,816 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:17:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:22:52 UTC)" (scheduled at 2021-11-08 15:17:52.376404+00:00) notificationworker stdout | 2021-11-08 15:17:52,406 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:22:52 UTC)" executed successfully gcworker stdout | 2021-11-08 15:17:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:22 UTC)" (scheduled at 2021-11-08 15:17:52.617060+00:00) gcworker stdout | 2021-11-08 15:17:52,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:22 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:17:53 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.097 325 0.097) gunicorn-registry stdout | 2021-11-08 15:17:53,646 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:17:53 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:17:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:54 UTC)" (scheduled at 2021-11-08 15:17:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:17:54,186 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:54 UTC)" executed successfully securityworker stdout | 2021-11-08 15:17:54,943 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:17:54,943 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:17:54,944 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:17 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:17:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:55 UTC)" (scheduled at 2021-11-08 15:17:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:17:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:18:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:18:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:10 UTC)" (scheduled at 2021-11-08 15:18:00.322052+00:00) notificationworker stdout | 2021-11-08 15:18:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:10 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:18:00,377 [237] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:18:00 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:18:00 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.082 325 0.082) gunicorn-registry stdout | 2021-11-08 15:18:05,031 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:18:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:18:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.091 325 0.091) exportactionlogsworker stdout | 2021-11-08 15:18:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:06 UTC)" (scheduled at 2021-11-08 15:18:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:18:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:18:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:09 UTC)" (scheduled at 2021-11-08 15:18:09.376681+00:00) notificationworker stdout | 2021-11-08 15:18:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:18:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:20 UTC)" (scheduled at 2021-11-08 15:18:10.322052+00:00) notificationworker stdout | 2021-11-08 15:18:10,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:18:14 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.076 325 0.076) gunicorn-registry stdout | 2021-11-08 15:18:14,594 [234] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:18:14 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:18:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:23:14 UTC)" (scheduled at 2021-11-08 15:18:14.905355+00:00) repositorygcworker stdout | 2021-11-08 15:18:14,922 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:23:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:18:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:16 UTC)" (scheduled at 2021-11-08 15:18:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:18:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:18:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:47 UTC)" (scheduled at 2021-11-08 15:18:17.787050+00:00) securityworker stdout | 2021-11-08 15:18:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 360-400 securityworker stdout | 2021-11-08 15:18:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:18:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 15:18:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 15:18:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:18:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 15:18:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 15:18:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 15:18:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 15:18:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 269-309 securityworker stdout | 2021-11-08 15:18:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 15:18:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 15:18:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 15:18:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 15:18:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 15:18:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 15:18:17,854 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:18:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 15:18:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:18:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:18:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 242-282 securityworker stdout | 2021-11-08 15:18:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:18:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:18:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 15:18:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 15:18:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 15:18:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 15:18:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 15:18:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:18:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:18:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 15:18:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 336-376 securityworker stdout | 2021-11-08 15:18:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:18:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:18:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 15:18:17,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 15:18:17,898 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:18:17,908 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:18:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:30 UTC)" (scheduled at 2021-11-08 15:18:20.322052+00:00) notificationworker stdout | 2021-11-08 15:18:20,454 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:18:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:51 UTC)" (scheduled at 2021-11-08 15:18:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:18:21,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:18:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:52 UTC)" (scheduled at 2021-11-08 15:18:22.617060+00:00) gcworker stdout | 2021-11-08 15:18:22,640 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:52 UTC)" executed successfully securityworker stdout | 2021-11-08 15:18:23,998 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:18:23,998 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:18:23,999 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:18:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:18:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:27 UTC)" (scheduled at 2021-11-08 15:18:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:18:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:18:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:40 UTC)" (scheduled at 2021-11-08 15:18:30.322052+00:00) notificationworker stdout | 2021-11-08 15:18:30,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:18:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:50 UTC)" (scheduled at 2021-11-08 15:18:40.322052+00:00) notificationworker stdout | 2021-11-08 15:18:40,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:18:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:18:46,753 [235] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:18:46 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:18:46 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.088 325 0.087) securityworker stdout | 2021-11-08 15:18:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:17 UTC)" (scheduled at 2021-11-08 15:18:47.787050+00:00) securityworker stdout | 2021-11-08 15:18:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 15:18:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 15:18:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 15:18:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 15:18:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:18:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:18:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:18:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:18:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 15:18:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 15:18:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:18:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 15:18:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 15:18:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:18:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 15:18:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 15:18:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 460-464 securityworker stdout | 2021-11-08 15:18:47,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 15:18:47,907 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:18:47,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:18:47,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 15:18:47,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 15:18:47,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 15:18:47,920 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 15:18:47,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 15:18:47,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 15:18:47,927 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:18:47,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:18:47,932 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:18:47,935 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 27-67 securityworker stdout | 2021-11-08 15:18:47,937 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 82-122 securityworker stdout | 2021-11-08 15:18:47,940 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 15:18:47,942 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 15:18:47,946 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:18:47,950 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 67-107 securityworker stdout | 2021-11-08 15:18:47,956 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 15:18:47,956 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:18:47,965 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:18:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:00 UTC)" (scheduled at 2021-11-08 15:18:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 15:18:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:50 UTC)" (scheduled at 2021-11-08 15:18:50.393684+00:00) notificationworker stdout | 2021-11-08 15:18:50,504 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:18:50,600 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:18:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:21 UTC)" (scheduled at 2021-11-08 15:18:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:18:51,904 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:18:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:22 UTC)" (scheduled at 2021-11-08 15:18:52.617060+00:00) gunicorn-registry stdout | 2021-11-08 15:18:52,619 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:18:52 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:18:52 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.084 325 0.083) gcworker stdout | 2021-11-08 15:18:52,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:22 UTC)" executed successfully securityworker stdout | 2021-11-08 15:18:53,550 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:18:53,551 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:18:53,551 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:18:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:54 UTC)" (scheduled at 2021-11-08 15:18:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:18:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:18:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:55 UTC)" (scheduled at 2021-11-08 15:18:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:18:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:19:55 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:18:56,614 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:18:56 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:18:56 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.089 325 0.089) gunicorn-registry stdout | 2021-11-08 15:18:59,479 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:18:59 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:18:59 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.078 325 0.078) notificationworker stdout | 2021-11-08 15:19:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:10 UTC)" (scheduled at 2021-11-08 15:19:00.322052+00:00) notificationworker stdout | 2021-11-08 15:19:00,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:10 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:19:00,418 [241] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:19:00 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.005 272 0.005) gunicorn-registry stdout | 2021-11-08 15:19:00,421 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:19:00 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:19:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:06 UTC)" (scheduled at 2021-11-08 15:19:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:19:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:19:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:09 UTC)" (scheduled at 2021-11-08 15:19:09.376681+00:00) notificationworker stdout | 2021-11-08 15:19:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:19:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:20 UTC)" (scheduled at 2021-11-08 15:19:10.322052+00:00) notificationworker stdout | 2021-11-08 15:19:10,343 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:19:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:16 UTC)" (scheduled at 2021-11-08 15:19:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:19:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:19:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:47 UTC)" (scheduled at 2021-11-08 15:19:17.787050+00:00) securityworker stdout | 2021-11-08 15:19:17,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 15:19:17,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 15:19:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 12-52 securityworker stdout | 2021-11-08 15:19:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 52-92 securityworker stdout | 2021-11-08 15:19:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:19:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 15:19:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:19:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 15:19:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 15:19:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:19:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 15:19:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 15:19:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:19:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:19:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 15:19:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 15:19:17,845 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:19:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:19:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 15:19:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:19:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 15:19:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 281-321 securityworker stdout | 2021-11-08 15:19:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:19:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:19:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 15:19:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:19:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 15:19:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 15:19:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:19:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:19:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 81-121 securityworker stdout | 2021-11-08 15:19:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 15:19:17,878 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:19:17,886 [102] [INFO] [util.migrate.allocator] Found 39 candidates, processing block securityworker stdout | 2021-11-08 15:19:19,399 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:19:19,399 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:19:19,400 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:19:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:30 UTC)" (scheduled at 2021-11-08 15:19:20.322052+00:00) notificationworker stdout | 2021-11-08 15:19:20,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:19:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:51 UTC)" (scheduled at 2021-11-08 15:19:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:19:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:19:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:52 UTC)" (scheduled at 2021-11-08 15:19:22.617060+00:00) gcworker stdout | 2021-11-08 15:19:22,638 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:19:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:19:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:27 UTC)" (scheduled at 2021-11-08 15:19:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:19:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:19:30,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:40 UTC)" (scheduled at 2021-11-08 15:19:30.322052+00:00) notificationworker stdout | 2021-11-08 15:19:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:19:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:50 UTC)" (scheduled at 2021-11-08 15:19:40.322052+00:00) notificationworker stdout | 2021-11-08 15:19:40,346 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:19:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:19:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:17 UTC)" (scheduled at 2021-11-08 15:19:47.787050+00:00) securityworker stdout | 2021-11-08 15:19:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 15:19:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:19:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 15:19:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 15:19:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 15:19:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:19:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 288-328 securityworker stdout | 2021-11-08 15:19:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 15:19:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:19:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 15:19:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 15:19:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:19:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:19:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 15:19:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 securityworker stdout | 2021-11-08 15:19:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 15:19:47,863 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:19:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:19:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 453-464 securityworker stdout | 2021-11-08 15:19:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 15:19:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 15:19:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 15:19:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:19:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 15:19:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:19:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 15:19:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 32-72 securityworker stdout | 2021-11-08 15:19:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:19:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 15:19:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:19:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 307-347 securityworker stdout | 2021-11-08 15:19:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 15:19:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 15:19:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 15:19:47,902 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:19:47,908 [102] [INFO] [util.migrate.allocator] Found 17 candidates, processing block notificationworker stdout | 2021-11-08 15:19:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:00 UTC)" (scheduled at 2021-11-08 15:19:50.322052+00:00) notificationworker stdout | 2021-11-08 15:19:50,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:19:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:50 UTC)" (scheduled at 2021-11-08 15:19:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:19:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:19:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:21 UTC)" (scheduled at 2021-11-08 15:19:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:19:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:19:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:22 UTC)" (scheduled at 2021-11-08 15:19:52.617060+00:00) gcworker stdout | 2021-11-08 15:19:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:19:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:54 UTC)" (scheduled at 2021-11-08 15:19:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:19:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:19:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:55 UTC)" (scheduled at 2021-11-08 15:19:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:19:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:20:55 UTC)" executed successfully securityworker stdout | 2021-11-08 15:19:55,474 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:19:55,474 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:19:55,475 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:20:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:10 UTC)" (scheduled at 2021-11-08 15:20:00.322052+00:00) notificationworker stdout | 2021-11-08 15:20:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:20:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:06 UTC)" (scheduled at 2021-11-08 15:20:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:20:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:20:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:09 UTC)" (scheduled at 2021-11-08 15:20:09.376681+00:00) notificationworker stdout | 2021-11-08 15:20:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:20:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:20 UTC)" (scheduled at 2021-11-08 15:20:10.322052+00:00) notificationworker stdout | 2021-11-08 15:20:10,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:20:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:16 UTC)" (scheduled at 2021-11-08 15:20:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:20:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:20:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:47 UTC)" (scheduled at 2021-11-08 15:20:17.787050+00:00) securityworker stdout | 2021-11-08 15:20:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:20:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 15:20:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 268-308 securityworker stdout | 2021-11-08 15:20:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 380-420 securityworker stdout | 2021-11-08 15:20:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 32-72 securityworker stdout | 2021-11-08 15:20:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 329-369 securityworker stdout | 2021-11-08 15:20:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 15:20:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 15:20:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 161-201 securityworker stdout | 2021-11-08 15:20:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 15:20:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:20:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 420-460 securityworker stdout | 2021-11-08 15:20:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 15:20:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 15:20:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 460-464 securityworker stdout | 2021-11-08 15:20:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 15:20:17,849 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:20:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 15:20:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 15:20:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 15:20:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:20:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:20:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 15:20:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:20:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 250-290 securityworker stdout | 2021-11-08 15:20:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 15:20:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 15:20:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 93-133 securityworker stdout | 2021-11-08 15:20:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:20:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 15:20:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:20:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 15:20:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 15:20:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 362-402 securityworker stdout | 2021-11-08 15:20:17,886 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:20:17,898 [102] [INFO] [util.migrate.allocator] Found 39 candidates, processing block securityworker stdout | 2021-11-08 15:20:19,417 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:20:19,417 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:20:19,418 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:20:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:30 UTC)" (scheduled at 2021-11-08 15:20:20.322052+00:00) notificationworker stdout | 2021-11-08 15:20:20,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:20:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:51 UTC)" (scheduled at 2021-11-08 15:20:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:20:21,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:20:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:52 UTC)" (scheduled at 2021-11-08 15:20:22.617060+00:00) gcworker stdout | 2021-11-08 15:20:22,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:20:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:20:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:27 UTC)" (scheduled at 2021-11-08 15:20:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:20:27,898 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:20:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:40 UTC)" (scheduled at 2021-11-08 15:20:30.322052+00:00) notificationworker stdout | 2021-11-08 15:20:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:20:36 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) gunicorn-registry stdout | 2021-11-08 15:20:36,884 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:20:36 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:20:40 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1689 0.015) gunicorn-registry stdout | 2021-11-08 15:20:40,063 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:20:40 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:20:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:50 UTC)" (scheduled at 2021-11-08 15:20:40.322052+00:00) notificationworker stdout | 2021-11-08 15:20:40,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:20:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:20:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:17 UTC)" (scheduled at 2021-11-08 15:20:47.787050+00:00) securityworker stdout | 2021-11-08 15:20:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 15:20:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 15:20:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:20:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 15:20:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 36-76 securityworker stdout | 2021-11-08 15:20:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 15:20:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:20:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 15:20:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 15:20:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 15:20:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 15:20:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:20:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:20:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 15:20:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 15:20:47,845 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:20:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 15:20:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:20:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:20:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:20:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 15:20:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 15:20:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 288-328 securityworker stdout | 2021-11-08 15:20:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:20:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 15:20:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 192-232 securityworker stdout | 2021-11-08 15:20:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 15:20:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 15:20:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 232-272 securityworker stdout | 2021-11-08 15:20:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 15:20:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:20:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 445-464 securityworker stdout | 2021-11-08 15:20:47,879 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:20:47,888 [102] [INFO] [util.migrate.allocator] Found 39 candidates, processing block securityworker stdout | 2021-11-08 15:20:49,277 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:20:49,277 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:20:49,277 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:17 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:20:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:25:49 UTC)" (scheduled at 2021-11-08 15:20:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 15:20:49,458 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:25:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:20:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:00 UTC)" (scheduled at 2021-11-08 15:20:50.322052+00:00) notificationworker stdout | 2021-11-08 15:20:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:20:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:50 UTC)" (scheduled at 2021-11-08 15:20:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:20:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:20:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:21 UTC)" (scheduled at 2021-11-08 15:20:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:20:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:20:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:22 UTC)" (scheduled at 2021-11-08 15:20:52.617060+00:00) gcworker stdout | 2021-11-08 15:20:52,638 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:20:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:54 UTC)" (scheduled at 2021-11-08 15:20:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:20:54,185 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:20:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:55 UTC)" (scheduled at 2021-11-08 15:20:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:20:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:21:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:21:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:10 UTC)" (scheduled at 2021-11-08 15:21:00.322052+00:00) notificationworker stdout | 2021-11-08 15:21:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:21:00 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.023 1690 0.023) gunicorn-registry stdout | 2021-11-08 15:21:00,435 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:21:00 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:21:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:06 UTC)" (scheduled at 2021-11-08 15:21:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:21:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:21:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:09 UTC)" (scheduled at 2021-11-08 15:21:09.376681+00:00) notificationworker stdout | 2021-11-08 15:21:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:21:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:20 UTC)" (scheduled at 2021-11-08 15:21:10.322052+00:00) notificationworker stdout | 2021-11-08 15:21:10,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:21:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:16 UTC)" (scheduled at 2021-11-08 15:21:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:21:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:21:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:47 UTC)" (scheduled at 2021-11-08 15:21:17.787050+00:00) securityworker stdout | 2021-11-08 15:21:17,808 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:21:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 10-50 securityworker stdout | 2021-11-08 15:21:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:21:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 15:21:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:21:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 15:21:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 15:21:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:21:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 263-303 securityworker stdout | 2021-11-08 15:21:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 15:21:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 15:21:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 15:21:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 15:21:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 303-343 securityworker stdout | 2021-11-08 15:21:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:21:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:21:17,848 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:21:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 15:21:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 98-138 securityworker stdout | 2021-11-08 15:21:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 15:21:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 25-65 securityworker stdout | 2021-11-08 15:21:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:21:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 290-330 securityworker stdout | 2021-11-08 15:21:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 15:21:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 15:21:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 15:21:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 15:21:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 15:21:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 15:21:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 179-219 securityworker stdout | 2021-11-08 15:21:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 330-370 securityworker stdout | 2021-11-08 15:21:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 15:21:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 444-464 securityworker stdout | 2021-11-08 15:21:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 15:21:17,893 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:21:17,898 [102] [INFO] [util.migrate.allocator] Found 20 candidates, processing block notificationworker stdout | 2021-11-08 15:21:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:30 UTC)" (scheduled at 2021-11-08 15:21:20.322052+00:00) notificationworker stdout | 2021-11-08 15:21:20,342 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:30 UTC)" executed successfully securityworker stdout | 2021-11-08 15:21:21,097 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:21:21,097 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:21:21,098 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:21:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:51 UTC)" (scheduled at 2021-11-08 15:21:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:21:21,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:21:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:52 UTC)" (scheduled at 2021-11-08 15:21:22.617060+00:00) gcworker stdout | 2021-11-08 15:21:22,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:21:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:21:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:27 UTC)" (scheduled at 2021-11-08 15:21:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:21:27,897 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:27 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:21:28 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.031 1690 0.031) gunicorn-registry stdout | 2021-11-08 15:21:28,658 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:21:28 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:21:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:40 UTC)" (scheduled at 2021-11-08 15:21:30.322052+00:00) notificationworker stdout | 2021-11-08 15:21:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:21:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:50 UTC)" (scheduled at 2021-11-08 15:21:40.322052+00:00) notificationworker stdout | 2021-11-08 15:21:40,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:21:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:21:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:17 UTC)" (scheduled at 2021-11-08 15:21:47.787050+00:00) securityworker stdout | 2021-11-08 15:21:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 15:21:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:21:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:21:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 15:21:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 15:21:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 264-304 securityworker stdout | 2021-11-08 15:21:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 304-344 securityworker stdout | 2021-11-08 15:21:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 15:21:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 15:21:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:21:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 15:21:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 15:21:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 15:21:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 15:21:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 15:21:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 15:21:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 15:21:47,851 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:21:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 12-52 securityworker stdout | 2021-11-08 15:21:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 15:21:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 15:21:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 15:21:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:21:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 15:21:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 15:21:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 15:21:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 15:21:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 15:21:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 52-92 securityworker stdout | 2021-11-08 15:21:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 15:21:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:21:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 320-360 securityworker stdout | 2021-11-08 15:21:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:21:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:21:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:21:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:21:47,902 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:21:47,912 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:21:49,889 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:21:49,889 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:21:49,890 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:21:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:00 UTC)" (scheduled at 2021-11-08 15:21:50.322052+00:00) notificationworker stdout | 2021-11-08 15:21:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:21:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:50 UTC)" (scheduled at 2021-11-08 15:21:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:21:50,408 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:21:50 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1690 0.013) gunicorn-registry stdout | 2021-11-08 15:21:50,762 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:21:50 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" buildlogsarchiver stdout | 2021-11-08 15:21:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:21 UTC)" (scheduled at 2021-11-08 15:21:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:21:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:21:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:22 UTC)" (scheduled at 2021-11-08 15:21:52.617060+00:00) gcworker stdout | 2021-11-08 15:21:52,636 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:21:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:54 UTC)" (scheduled at 2021-11-08 15:21:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:21:54,189 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:21:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:55 UTC)" (scheduled at 2021-11-08 15:21:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:21:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:22:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:22:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:10 UTC)" (scheduled at 2021-11-08 15:22:00.322052+00:00) notificationworker stdout | 2021-11-08 15:22:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:22:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:06 UTC)" (scheduled at 2021-11-08 15:22:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:22:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:22:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:09 UTC)" (scheduled at 2021-11-08 15:22:09.376681+00:00) notificationworker stdout | 2021-11-08 15:22:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:22:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:20 UTC)" (scheduled at 2021-11-08 15:22:10.322052+00:00) notificationworker stdout | 2021-11-08 15:22:10,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:22:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:16 UTC)" (scheduled at 2021-11-08 15:22:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:22:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:22:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:47 UTC)" (scheduled at 2021-11-08 15:22:17.787050+00:00) securityworker stdout | 2021-11-08 15:22:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 15:22:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 15:22:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 15:22:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:22:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 15:22:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 15:22:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 15:22:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 15:22:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:22:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 15:22:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 15:22:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 15:22:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 15:22:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 425-464 securityworker stdout | 2021-11-08 15:22:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:22:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:22:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:22:17,860 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:22:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 15:22:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 309-349 securityworker stdout | 2021-11-08 15:22:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 28-68 securityworker stdout | 2021-11-08 15:22:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 15:22:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:22:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 15:22:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 15:22:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 15:22:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 15:22:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 15:22:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:22:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:22:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 68-108 securityworker stdout | 2021-11-08 15:22:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 15:22:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 400-440 securityworker stdout | 2021-11-08 15:22:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:22:17,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 440-464 securityworker stdout | 2021-11-08 15:22:17,904 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:22:17,914 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:22:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:30 UTC)" (scheduled at 2021-11-08 15:22:20.322052+00:00) notificationworker stdout | 2021-11-08 15:22:20,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:30 UTC)" executed successfully securityworker stdout | 2021-11-08 15:22:20,789 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:22:20,789 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:22:20,790 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:22:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:51 UTC)" (scheduled at 2021-11-08 15:22:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:22:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:22:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:52 UTC)" (scheduled at 2021-11-08 15:22:22.617060+00:00) gcworker stdout | 2021-11-08 15:22:22,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:22:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:22:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:27 UTC)" (scheduled at 2021-11-08 15:22:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:22:27,897 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:22:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:40 UTC)" (scheduled at 2021-11-08 15:22:30.322052+00:00) notificationworker stdout | 2021-11-08 15:22:30,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:22:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:50 UTC)" (scheduled at 2021-11-08 15:22:40.322052+00:00) notificationworker stdout | 2021-11-08 15:22:40,347 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:22:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:22:44 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:22:44,543 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:22:44 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:22:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:27:46 UTC)" (scheduled at 2021-11-08 15:22:46.131205+00:00) namespacegcworker stdout | 2021-11-08 15:22:46,153 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:27:46 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:22:46,424 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:22:46 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:22:46 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) securityworker stdout | 2021-11-08 15:22:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:17 UTC)" (scheduled at 2021-11-08 15:22:47.787050+00:00) securityworker stdout | 2021-11-08 15:22:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 151-191 securityworker stdout | 2021-11-08 15:22:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 15:22:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 15:22:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 15:22:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 14-54 securityworker stdout | 2021-11-08 15:22:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:22:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 15:22:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 54-94 securityworker stdout | 2021-11-08 15:22:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 15:22:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 15:22:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 15:22:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 372-412 securityworker stdout | 2021-11-08 15:22:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 15:22:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 15:22:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 15:22:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 15:22:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:22:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 15:22:47,845 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:22:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 15:22:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:22:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 391-431 securityworker stdout | 2021-11-08 15:22:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 15:22:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 15:22:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 15-55 securityworker stdout | 2021-11-08 15:22:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 57-97 securityworker stdout | 2021-11-08 15:22:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 15:22:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:22:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 15:22:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:22:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 15:22:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:22:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 15:22:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 15:22:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:22:47,876 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:22:47,884 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 15:22:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:00 UTC)" (scheduled at 2021-11-08 15:22:50.322052+00:00) notificationworker stdout | 2021-11-08 15:22:50,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:22:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:50 UTC)" (scheduled at 2021-11-08 15:22:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:22:50,413 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:22:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:21 UTC)" (scheduled at 2021-11-08 15:22:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:22:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:21 UTC)" executed successfully securityworker stdout | 2021-11-08 15:22:52,058 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:22:52,058 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:22:52,059 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:22:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:27:52 UTC)" (scheduled at 2021-11-08 15:22:52.376404+00:00) notificationworker stdout | 2021-11-08 15:22:52,396 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:27:52 UTC)" executed successfully gcworker stdout | 2021-11-08 15:22:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:22 UTC)" (scheduled at 2021-11-08 15:22:52.617060+00:00) gcworker stdout | 2021-11-08 15:22:52,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:22:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:54 UTC)" (scheduled at 2021-11-08 15:22:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:22:54,186 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:22:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:55 UTC)" (scheduled at 2021-11-08 15:22:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:22:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:23:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:22:59 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:22:59,493 [233] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:22:59 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:23:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:10 UTC)" (scheduled at 2021-11-08 15:23:00.322052+00:00) notificationworker stdout | 2021-11-08 15:23:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:23:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:06 UTC)" (scheduled at 2021-11-08 15:23:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:23:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:23:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:09 UTC)" (scheduled at 2021-11-08 15:23:09.376681+00:00) notificationworker stdout | 2021-11-08 15:23:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:09 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:23:09 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:23:09,921 [232] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:23:09 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:23:10 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:23:10,278 [232] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:23:10 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:23:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:20 UTC)" (scheduled at 2021-11-08 15:23:10.322052+00:00) notificationworker stdout | 2021-11-08 15:23:10,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:23:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:28:14 UTC)" (scheduled at 2021-11-08 15:23:14.905355+00:00) repositorygcworker stdout | 2021-11-08 15:23:14,925 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:28:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:23:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:16 UTC)" (scheduled at 2021-11-08 15:23:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:23:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:23:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:47 UTC)" (scheduled at 2021-11-08 15:23:17.787050+00:00) securityworker stdout | 2021-11-08 15:23:19,467 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 15:23:19,469 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 215-255 securityworker stdout | 2021-11-08 15:23:19,471 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 15:23:19,473 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 15:23:19,475 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 15:23:19,478 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 15:23:19,479 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 15:23:19,481 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 15:23:19,483 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 15:23:19,485 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 36-76 securityworker stdout | 2021-11-08 15:23:19,487 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 15:23:19,488 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:23:19,490 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 15:23:19,493 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:23:19,495 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 15:23:19,498 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 15:23:19,498 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:23:19,501 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 179-219 securityworker stdout | 2021-11-08 15:23:19,504 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 15:23:19,507 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 15:23:19,511 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 15:23:19,514 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 15:23:19,516 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 15:23:19,518 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 15:23:19,520 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 238-278 securityworker stdout | 2021-11-08 15:23:19,523 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 15:23:19,525 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 219-259 securityworker stdout | 2021-11-08 15:23:19,527 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 15:23:19,530 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 15:23:19,532 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 15:23:19,534 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:23:19,536 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 15:23:19,543 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:23:19,547 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 15:23:19,547 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:23:19,608 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:23:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:30 UTC)" (scheduled at 2021-11-08 15:23:20.322052+00:00) notificationworker stdout | 2021-11-08 15:23:20,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:30 UTC)" executed successfully securityworker stdout | 2021-11-08 15:23:21,676 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:23:21,676 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:23:21,677 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:23:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:51 UTC)" (scheduled at 2021-11-08 15:23:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:23:21,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:23:22,653 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:52 UTC)" (scheduled at 2021-11-08 15:23:22.617060+00:00) gcworker stdout | 2021-11-08 15:23:22,669 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:23:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:23:23 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 15:23:23,494 [236] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:23:23 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:23:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:27 UTC)" (scheduled at 2021-11-08 15:23:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:23:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:23:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:40 UTC)" (scheduled at 2021-11-08 15:23:30.322052+00:00) notificationworker stdout | 2021-11-08 15:23:30,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:23:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:50 UTC)" (scheduled at 2021-11-08 15:23:40.322052+00:00) notificationworker stdout | 2021-11-08 15:23:40,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:23:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:23:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:17 UTC)" (scheduled at 2021-11-08 15:23:47.787050+00:00) securityworker stdout | 2021-11-08 15:23:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:23:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:23:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 15:23:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 15:23:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 15:23:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 15:23:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 15:23:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 15:23:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:23:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:23:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 15:23:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 15:23:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 15:23:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 15:23:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 15:23:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:23:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 451-464 securityworker stdout | 2021-11-08 15:23:47,866 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:23:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:23:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 15:23:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 15:23:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 15:23:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 15:23:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:23:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:23:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 15:23:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 15:23:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 15:23:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 15:23:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 15:23:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:23:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 15:23:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 15:23:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 15:23:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 15:23:47,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 15:23:47,908 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:23:47,917 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:23:49,874 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:23:49,875 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:23:49,876 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:23:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:00 UTC)" (scheduled at 2021-11-08 15:23:50.322052+00:00) notificationworker stdout | 2021-11-08 15:23:50,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:23:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:50 UTC)" (scheduled at 2021-11-08 15:23:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:23:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:23:51,608 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:23:51 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:23:51 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) buildlogsarchiver stdout | 2021-11-08 15:23:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:21 UTC)" (scheduled at 2021-11-08 15:23:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:23:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:23:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:22 UTC)" (scheduled at 2021-11-08 15:23:52.617060+00:00) gcworker stdout | 2021-11-08 15:23:52,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:23:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:54 UTC)" (scheduled at 2021-11-08 15:23:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:23:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:23:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:55 UTC)" (scheduled at 2021-11-08 15:23:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:23:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:24:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:23:58 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 15:23:58,497 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:23:58 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:24:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:10 UTC)" (scheduled at 2021-11-08 15:24:00.322052+00:00) notificationworker stdout | 2021-11-08 15:24:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:24:05 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:24:05,410 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:24:05 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:24:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:06 UTC)" (scheduled at 2021-11-08 15:24:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:24:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:24:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:09 UTC)" (scheduled at 2021-11-08 15:24:09.376681+00:00) notificationworker stdout | 2021-11-08 15:24:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:09 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:24:09,497 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:24:09 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:24:09 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.094 325 0.094) notificationworker stdout | 2021-11-08 15:24:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:20 UTC)" (scheduled at 2021-11-08 15:24:10.322052+00:00) notificationworker stdout | 2021-11-08 15:24:10,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:20 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:24:10,604 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:24:10 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:24:10 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.091 325 0.091) repositorygcworker stdout | 2021-11-08 15:24:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:16 UTC)" (scheduled at 2021-11-08 15:24:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:24:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:24:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:47 UTC)" (scheduled at 2021-11-08 15:24:17.787050+00:00) securityworker stdout | 2021-11-08 15:24:17,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 15:24:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 15:24:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 40-80 securityworker stdout | 2021-11-08 15:24:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 15:24:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 15:24:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 15:24:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 80-120 securityworker stdout | 2021-11-08 15:24:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:24:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:24:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 15:24:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 294-334 securityworker stdout | 2021-11-08 15:24:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 15:24:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 334-374 securityworker stdout | 2021-11-08 15:24:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 451-464 securityworker stdout | 2021-11-08 15:24:17,848 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:24:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 288-328 securityworker stdout | 2021-11-08 15:24:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:24:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:24:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 15:24:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:24:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:24:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 83-123 securityworker stdout | 2021-11-08 15:24:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 15:24:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 15:24:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 15:24:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 15:24:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 15:24:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 15:24:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 15:24:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 15:24:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 15:24:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 15:24:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 454-464 securityworker stdout | 2021-11-08 15:24:17,885 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:24:17,896 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:24:18,886 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:24:18,886 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:24:18,887 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:24:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:30 UTC)" (scheduled at 2021-11-08 15:24:20.322052+00:00) notificationworker stdout | 2021-11-08 15:24:20,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:24:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:51 UTC)" (scheduled at 2021-11-08 15:24:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:24:21,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:24:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:52 UTC)" (scheduled at 2021-11-08 15:24:22.617060+00:00) gcworker stdout | 2021-11-08 15:24:22,680 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:24:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:24:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:27 UTC)" (scheduled at 2021-11-08 15:24:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:24:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:24:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:40 UTC)" (scheduled at 2021-11-08 15:24:30.322052+00:00) notificationworker stdout | 2021-11-08 15:24:30,452 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:24:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:50 UTC)" (scheduled at 2021-11-08 15:24:40.322052+00:00) notificationworker stdout | 2021-11-08 15:24:40,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:24:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:24:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:17 UTC)" (scheduled at 2021-11-08 15:24:47.787050+00:00) securityworker stdout | 2021-11-08 15:24:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:24:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 15:24:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 15:24:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 15:24:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 15:24:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 358-398 securityworker stdout | 2021-11-08 15:24:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 15:24:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 15:24:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:24:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 15:24:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 15:24:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 15:24:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 15:24:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 15:24:47,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 15:24:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 15:24:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 447-464 securityworker stdout | 2021-11-08 15:24:47,851 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:24:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:24:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 15:24:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 15:24:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:24:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 15:24:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:24:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:24:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 15:24:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 15:24:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 234-274 securityworker stdout | 2021-11-08 15:24:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 15:24:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 15:24:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 15:24:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:24:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 15:24:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 15:24:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:24:47,886 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:24:47,893 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:24:49,219 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:24:49,219 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:24:49,220 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:24:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:00 UTC)" (scheduled at 2021-11-08 15:24:50.322052+00:00) notificationworker stdout | 2021-11-08 15:24:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:24:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:50 UTC)" (scheduled at 2021-11-08 15:24:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:24:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:24:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:21 UTC)" (scheduled at 2021-11-08 15:24:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:24:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:24:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:22 UTC)" (scheduled at 2021-11-08 15:24:52.617060+00:00) gcworker stdout | 2021-11-08 15:24:52,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:24:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:54 UTC)" (scheduled at 2021-11-08 15:24:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:24:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:24:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:55 UTC)" (scheduled at 2021-11-08 15:24:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:24:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:25:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:25:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:10 UTC)" (scheduled at 2021-11-08 15:25:00.322052+00:00) notificationworker stdout | 2021-11-08 15:25:00,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:25:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:06 UTC)" (scheduled at 2021-11-08 15:25:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:25:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:25:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:09 UTC)" (scheduled at 2021-11-08 15:25:09.376681+00:00) notificationworker stdout | 2021-11-08 15:25:09,378 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:25:10,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:20 UTC)" (scheduled at 2021-11-08 15:25:10.322052+00:00) notificationworker stdout | 2021-11-08 15:25:10,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:25:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:16 UTC)" (scheduled at 2021-11-08 15:25:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:25:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:25:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:47 UTC)" (scheduled at 2021-11-08 15:25:17.787050+00:00) securityworker stdout | 2021-11-08 15:25:17,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 15:25:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 13-53 securityworker stdout | 2021-11-08 15:25:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 53-93 securityworker stdout | 2021-11-08 15:25:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:25:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 15:25:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 15:25:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 15:25:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 15:25:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 307-347 securityworker stdout | 2021-11-08 15:25:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 15:25:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 15:25:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 175-215 securityworker stdout | 2021-11-08 15:25:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 347-387 securityworker stdout | 2021-11-08 15:25:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:25:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 15:25:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 15:25:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:25:17,852 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:25:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 15:25:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:25:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 15:25:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 15:25:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 15:25:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:25:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 15:25:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 15:25:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 243-283 securityworker stdout | 2021-11-08 15:25:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:25:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 15:25:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 15:25:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 363-403 securityworker stdout | 2021-11-08 15:25:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 403-443 securityworker stdout | 2021-11-08 15:25:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 15:25:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 15:25:17,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 15:25:17,902 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:25:17,915 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:25:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:30 UTC)" (scheduled at 2021-11-08 15:25:20.322052+00:00) notificationworker stdout | 2021-11-08 15:25:20,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:25:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:51 UTC)" (scheduled at 2021-11-08 15:25:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:25:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:25:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:52 UTC)" (scheduled at 2021-11-08 15:25:22.617060+00:00) gcworker stdout | 2021-11-08 15:25:22,635 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:52 UTC)" executed successfully securityworker stdout | 2021-11-08 15:25:24,142 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:25:24,142 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:25:24,143 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:25:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:25:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:27 UTC)" (scheduled at 2021-11-08 15:25:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:25:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:25:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:40 UTC)" (scheduled at 2021-11-08 15:25:30.322052+00:00) notificationworker stdout | 2021-11-08 15:25:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:25:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:50 UTC)" (scheduled at 2021-11-08 15:25:40.322052+00:00) notificationworker stdout | 2021-11-08 15:25:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:25:50 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:25:45 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.106 325 0.106) gunicorn-registry stdout | 2021-11-08 15:25:45,741 [242] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:25:45 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 15:25:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:17 UTC)" (scheduled at 2021-11-08 15:25:47.787050+00:00) securityworker stdout | 2021-11-08 15:25:47,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 277-317 securityworker stdout | 2021-11-08 15:25:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 157-197 securityworker stdout | 2021-11-08 15:25:47,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 15:25:47,817 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 15:25:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 197-237 securityworker stdout | 2021-11-08 15:25:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 15:25:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 15:25:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:25:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 117-157 securityworker stdout | 2021-11-08 15:25:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:25:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:25:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 15:25:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 15:25:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 15:25:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 15:25:47,841 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:25:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 72-112 securityworker stdout | 2021-11-08 15:25:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 15:25:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 15:25:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:25:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 15:25:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:25:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:25:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:25:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 15:25:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 15:25:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 205-245 securityworker stdout | 2021-11-08 15:25:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:25:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 15:25:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 453-464 securityworker stdout | 2021-11-08 15:25:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 15:25:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 112-152 securityworker stdout | 2021-11-08 15:25:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 15:25:47,878 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:25:47,886 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 15:25:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:30:49 UTC)" (scheduled at 2021-11-08 15:25:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 15:25:49,455 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:30:49 UTC)" executed successfully securityworker stdout | 2021-11-08 15:25:49,569 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:25:49,569 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:25:49,570 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:25:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:00 UTC)" (scheduled at 2021-11-08 15:25:50.322052+00:00) notificationworker stdout | 2021-11-08 15:25:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:25:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:50 UTC)" (scheduled at 2021-11-08 15:25:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:25:50,407 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:50 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:25:51,035 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:25:51 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:25:51 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.090 325 0.089) buildlogsarchiver stdout | 2021-11-08 15:25:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:21 UTC)" (scheduled at 2021-11-08 15:25:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:25:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:25:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:22 UTC)" (scheduled at 2021-11-08 15:25:52.617060+00:00) gcworker stdout | 2021-11-08 15:25:52,630 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:25:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:54 UTC)" (scheduled at 2021-11-08 15:25:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:25:54,181 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:25:55,133 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:55 UTC)" (scheduled at 2021-11-08 15:25:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:25:55,134 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:26:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:26:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:10 UTC)" (scheduled at 2021-11-08 15:26:00.322052+00:00) notificationworker stdout | 2021-11-08 15:26:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:26:03 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.193 325 0.193) gunicorn-registry stdout | 2021-11-08 15:26:03,537 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:26:03 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:26:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:06 UTC)" (scheduled at 2021-11-08 15:26:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:26:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:26:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:09 UTC)" (scheduled at 2021-11-08 15:26:09.376681+00:00) notificationworker stdout | 2021-11-08 15:26:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:26:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:20 UTC)" (scheduled at 2021-11-08 15:26:10.322052+00:00) notificationworker stdout | 2021-11-08 15:26:10,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:26:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:16 UTC)" (scheduled at 2021-11-08 15:26:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:26:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:26:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:47 UTC)" (scheduled at 2021-11-08 15:26:17.787050+00:00) securityworker stdout | 2021-11-08 15:26:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 15:26:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 15:26:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 15:26:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 146-186 securityworker stdout | 2021-11-08 15:26:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 15:26:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 186-226 securityworker stdout | 2021-11-08 15:26:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:26:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 15:26:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 269-309 securityworker stdout | 2021-11-08 15:26:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 15:26:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 15:26:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:26:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 15:26:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 15:26:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:26:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:26:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 15:26:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 414-454 securityworker stdout | 2021-11-08 15:26:17,853 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:26:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:26:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 15:26:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 15:26:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 81-121 securityworker stdout | 2021-11-08 15:26:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 15:26:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:26:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 15:26:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 15:26:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:26:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:26:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 121-161 securityworker stdout | 2021-11-08 15:26:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 15:26:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 15:26:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 15:26:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:26:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 424-464 securityworker stdout | 2021-11-08 15:26:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 15:26:17,889 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:26:17,897 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 15:26:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:30 UTC)" (scheduled at 2021-11-08 15:26:20.322052+00:00) notificationworker stdout | 2021-11-08 15:26:20,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:26:21,795 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:51 UTC)" (scheduled at 2021-11-08 15:26:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:26:21,813 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:26:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:52 UTC)" (scheduled at 2021-11-08 15:26:22.617060+00:00) gcworker stdout | 2021-11-08 15:26:22,640 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:52 UTC)" executed successfully securityworker stdout | 2021-11-08 15:26:24,537 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:26:24,537 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:26:24,537 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:26:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:26:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:27 UTC)" (scheduled at 2021-11-08 15:26:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:26:27,897 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:26:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:40 UTC)" (scheduled at 2021-11-08 15:26:30.322052+00:00) notificationworker stdout | 2021-11-08 15:26:30,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:40 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:26:37 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.226 325 0.226) gunicorn-registry stdout | 2021-11-08 15:26:37,899 [245] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:26:37 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:26:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:50 UTC)" (scheduled at 2021-11-08 15:26:40.322052+00:00) notificationworker stdout | 2021-11-08 15:26:40,359 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:26:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:26:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:17 UTC)" (scheduled at 2021-11-08 15:26:47.787050+00:00) securityworker stdout | 2021-11-08 15:26:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 138-178 securityworker stdout | 2021-11-08 15:26:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 9-49 securityworker stdout | 2021-11-08 15:26:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 58-98 securityworker stdout | 2021-11-08 15:26:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 98-138 securityworker stdout | 2021-11-08 15:26:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:26:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 15:26:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:26:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 364-404 securityworker stdout | 2021-11-08 15:26:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 15:26:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 178-218 securityworker stdout | 2021-11-08 15:26:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 15:26:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 15:26:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 15:26:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 362-402 securityworker stdout | 2021-11-08 15:26:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 15:26:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 15:26:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 446-464 securityworker stdout | 2021-11-08 15:26:47,862 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:26:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 21-61 securityworker stdout | 2021-11-08 15:26:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:26:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 15:26:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 141-181 securityworker stdout | 2021-11-08 15:26:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 181-221 securityworker stdout | 2021-11-08 15:26:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:26:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 15:26:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 15:26:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 276-316 securityworker stdout | 2021-11-08 15:26:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 15:26:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:26:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 387-427 securityworker stdout | 2021-11-08 15:26:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 15:26:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 386-426 securityworker stdout | 2021-11-08 15:26:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 427-464 securityworker stdout | 2021-11-08 15:26:47,898 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:26:47,907 [102] [INFO] [util.migrate.allocator] Found 39 candidates, processing block notificationworker stdout | 2021-11-08 15:26:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:00 UTC)" (scheduled at 2021-11-08 15:26:50.322052+00:00) notificationworker stdout | 2021-11-08 15:26:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:26:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:50 UTC)" (scheduled at 2021-11-08 15:26:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:26:50,406 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:26:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:21 UTC)" (scheduled at 2021-11-08 15:26:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:26:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:26:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:22 UTC)" (scheduled at 2021-11-08 15:26:52.617060+00:00) gcworker stdout | 2021-11-08 15:26:52,630 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:22 UTC)" executed successfully securityworker stdout | 2021-11-08 15:26:54,096 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:26:54,097 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:26:54,098 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:26:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:54 UTC)" (scheduled at 2021-11-08 15:26:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:26:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:26:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:55 UTC)" (scheduled at 2021-11-08 15:26:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:26:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:27:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:26:58 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.091 325 0.091) gunicorn-registry stdout | 2021-11-08 15:26:58,614 [235] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:26:58 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:27:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:10 UTC)" (scheduled at 2021-11-08 15:27:00.322052+00:00) notificationworker stdout | 2021-11-08 15:27:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:27:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:06 UTC)" (scheduled at 2021-11-08 15:27:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:27:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:27:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:09 UTC)" (scheduled at 2021-11-08 15:27:09.376681+00:00) notificationworker stdout | 2021-11-08 15:27:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:27:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:20 UTC)" (scheduled at 2021-11-08 15:27:10.322052+00:00) notificationworker stdout | 2021-11-08 15:27:10,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:27:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:16 UTC)" (scheduled at 2021-11-08 15:27:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:27:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:27:17,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:47 UTC)" (scheduled at 2021-11-08 15:27:17.787050+00:00) securityworker stdout | 2021-11-08 15:27:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 15:27:17,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 15:27:17,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 15:27:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 15:27:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 15:27:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 15:27:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 15:27:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 15:27:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 15:27:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 257-297 securityworker stdout | 2021-11-08 15:27:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 15:27:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 15:27:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:27:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 22-62 securityworker stdout | 2021-11-08 15:27:17,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:27:17,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 15:27:17,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 15:27:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 439-464 securityworker stdout | 2021-11-08 15:27:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 15:27:17,858 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:27:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 15:27:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:27:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:27:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 15:27:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 320-360 securityworker stdout | 2021-11-08 15:27:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 360-400 securityworker stdout | 2021-11-08 15:27:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:27:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:27:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 15:27:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 15:27:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 15:27:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:27:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:27:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 15:27:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 94-134 securityworker stdout | 2021-11-08 15:27:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 15:27:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 134-174 securityworker stdout | 2021-11-08 15:27:17,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 15:27:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 15:27:17,899 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:27:17,908 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:27:18,765 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:27:18,765 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:27:18,766 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:27:20,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:30 UTC)" (scheduled at 2021-11-08 15:27:20.322052+00:00) notificationworker stdout | 2021-11-08 15:27:20,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:30 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:27:21,347 [239] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:27:21 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.004 272 0.004) gunicorn-registry stdout | 2021-11-08 15:27:21,349 [239] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:27:21 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" buildlogsarchiver stdout | 2021-11-08 15:27:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:51 UTC)" (scheduled at 2021-11-08 15:27:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:27:21,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:27:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:52 UTC)" (scheduled at 2021-11-08 15:27:22.617060+00:00) gcworker stdout | 2021-11-08 15:27:22,632 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:27:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:27:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:27 UTC)" (scheduled at 2021-11-08 15:27:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:27:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:27:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:40 UTC)" (scheduled at 2021-11-08 15:27:30.322052+00:00) notificationworker stdout | 2021-11-08 15:27:30,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:27:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:50 UTC)" (scheduled at 2021-11-08 15:27:40.322052+00:00) notificationworker stdout | 2021-11-08 15:27:40,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:27:50 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:27:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:32:46 UTC)" (scheduled at 2021-11-08 15:27:46.131205+00:00) namespacegcworker stdout | 2021-11-08 15:27:46,157 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:32:46 UTC)" executed successfully securityworker stdout | 2021-11-08 15:27:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:17 UTC)" (scheduled at 2021-11-08 15:27:47.787050+00:00) securityworker stdout | 2021-11-08 15:27:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 15:27:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 419-459 securityworker stdout | 2021-11-08 15:27:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 15:27:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 15:27:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 15:27:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 15:27:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 15:27:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:27:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 15:27:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 15:27:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 15:27:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 15:27:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 15:27:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 459-464 securityworker stdout | 2021-11-08 15:27:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:27:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 15:27:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:27:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 15:27:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:27:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 15:27:47,881 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:27:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:27:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 399-439 securityworker stdout | 2021-11-08 15:27:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:27:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 439-464 securityworker stdout | 2021-11-08 15:27:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 120-160 securityworker stdout | 2021-11-08 15:27:47,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:27:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 91-131 securityworker stdout | 2021-11-08 15:27:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 15:27:47,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 15:27:47,908 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 15:27:47,910 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 217-257 securityworker stdout | 2021-11-08 15:27:47,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 9-49 securityworker stdout | 2021-11-08 15:27:47,914 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 15:27:47,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:27:47,919 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 160-200 securityworker stdout | 2021-11-08 15:27:47,921 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:27:47,924 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 15:27:47,924 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:27:47,934 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:27:49,551 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:27:49,552 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:27:49,553 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:17 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:27:49 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.025 1690 0.024) gunicorn-registry stdout | 2021-11-08 15:27:49,865 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:27:49 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:27:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:00 UTC)" (scheduled at 2021-11-08 15:27:50.322052+00:00) notificationworker stdout | 2021-11-08 15:27:50,346 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:27:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:50 UTC)" (scheduled at 2021-11-08 15:27:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:27:50,428 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:27:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:21 UTC)" (scheduled at 2021-11-08 15:27:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:27:51,825 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:27:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:32:52 UTC)" (scheduled at 2021-11-08 15:27:52.376404+00:00) notificationworker stdout | 2021-11-08 15:27:52,401 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:32:52 UTC)" executed successfully gcworker stdout | 2021-11-08 15:27:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:22 UTC)" (scheduled at 2021-11-08 15:27:52.617060+00:00) gcworker stdout | 2021-11-08 15:27:52,642 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:27:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:54 UTC)" (scheduled at 2021-11-08 15:27:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:27:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:54 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:27:54 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.022 1689 0.021) gunicorn-registry stdout | 2021-11-08 15:27:54,664 [232] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:27:54 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-fipcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:27:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:55 UTC)" (scheduled at 2021-11-08 15:27:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:27:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:28:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:28:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:10 UTC)" (scheduled at 2021-11-08 15:28:00.322052+00:00) notificationworker stdout | 2021-11-08 15:28:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:28:04 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1690 0.019) gunicorn-registry stdout | 2021-11-08 15:28:04,795 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:28:04 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:28:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:06 UTC)" (scheduled at 2021-11-08 15:28:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:28:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:28:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:09 UTC)" (scheduled at 2021-11-08 15:28:09.376681+00:00) notificationworker stdout | 2021-11-08 15:28:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:28:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:20 UTC)" (scheduled at 2021-11-08 15:28:10.322052+00:00) notificationworker stdout | 2021-11-08 15:28:10,335 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:28:12 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1691 0.014) gunicorn-registry stdout | 2021-11-08 15:28:12,066 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:28:12 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-ficrmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:28:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:33:14 UTC)" (scheduled at 2021-11-08 15:28:14.905355+00:00) repositorygcworker stdout | 2021-11-08 15:28:14,924 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:33:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:28:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:16 UTC)" (scheduled at 2021-11-08 15:28:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:28:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:28:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:47 UTC)" (scheduled at 2021-11-08 15:28:17.787050+00:00) securityworker stdout | 2021-11-08 15:28:17,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 39-79 securityworker stdout | 2021-11-08 15:28:17,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:28:17,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:28:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 81-121 securityworker stdout | 2021-11-08 15:28:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 131-171 securityworker stdout | 2021-11-08 15:28:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 15:28:17,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 15:28:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 15:28:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 15:28:17,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 121-161 securityworker stdout | 2021-11-08 15:28:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 79-119 securityworker stdout | 2021-11-08 15:28:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 334-374 securityworker stdout | 2021-11-08 15:28:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 15:28:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 374-414 securityworker stdout | 2021-11-08 15:28:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 15:28:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 436-464 securityworker stdout | 2021-11-08 15:28:17,840 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:28:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 167-207 securityworker stdout | 2021-11-08 15:28:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 15:28:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 15:28:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 229-269 securityworker stdout | 2021-11-08 15:28:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 15:28:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 269-309 securityworker stdout | 2021-11-08 15:28:17,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 15:28:17,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 15:28:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:28:17,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 15:28:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 15:28:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 15:28:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:28:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 15:28:17,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 315-355 securityworker stdout | 2021-11-08 15:28:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 445-464 securityworker stdout | 2021-11-08 15:28:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 15:28:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 15:28:17,877 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:28:17,884 [102] [INFO] [util.migrate.allocator] Found 39 candidates, processing block nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:28:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1690 0.017) gunicorn-registry stdout | 2021-11-08 15:28:18,416 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:28:18 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-finbcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 15:28:19,018 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:28:19,018 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:28:19,019 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:28:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:30 UTC)" (scheduled at 2021-11-08 15:28:20.322052+00:00) notificationworker stdout | 2021-11-08 15:28:20,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:28:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:51 UTC)" (scheduled at 2021-11-08 15:28:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:28:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:28:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:52 UTC)" (scheduled at 2021-11-08 15:28:22.617060+00:00) gcworker stdout | 2021-11-08 15:28:22,631 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:28:52 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:28:25,646 [237] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:28:25 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:28:25 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.019 1690 0.019) namespacegcworker stdout | 2021-11-08 15:28:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:27 UTC)" (scheduled at 2021-11-08 15:28:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:28:27,897 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:28:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:40 UTC)" (scheduled at 2021-11-08 15:28:30.322052+00:00) notificationworker stdout | 2021-11-08 15:28:30,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:28:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:50 UTC)" (scheduled at 2021-11-08 15:28:40.322052+00:00) notificationworker stdout | 2021-11-08 15:28:40,350 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:28:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:28:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:17 UTC)" (scheduled at 2021-11-08 15:28:47.787050+00:00) securityworker stdout | 2021-11-08 15:28:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 15:28:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 15:28:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 15:28:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 15:28:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 15:28:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 24-64 securityworker stdout | 2021-11-08 15:28:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 15:28:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:28:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:28:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 262-302 securityworker stdout | 2021-11-08 15:28:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 15:28:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 15:28:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 15:28:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:28:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 425-464 securityworker stdout | 2021-11-08 15:28:47,842 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:28:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 52-92 securityworker stdout | 2021-11-08 15:28:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 15:28:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:28:47,850 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 15:28:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 15:28:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 126-166 securityworker stdout | 2021-11-08 15:28:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 282-322 securityworker stdout | 2021-11-08 15:28:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 362-402 securityworker stdout | 2021-11-08 15:28:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 322-362 securityworker stdout | 2021-11-08 15:28:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 15:28:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 15:28:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 15:28:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 15:28:47,870 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 15:28:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 15:28:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 15:28:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 15:28:47,875 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:28:47,884 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:28:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:00 UTC)" (scheduled at 2021-11-08 15:28:50.322052+00:00) notificationworker stdout | 2021-11-08 15:28:50,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:28:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:50 UTC)" (scheduled at 2021-11-08 15:28:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:28:50,408 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:28:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:21 UTC)" (scheduled at 2021-11-08 15:28:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:28:51,806 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:21 UTC)" executed successfully securityworker stdout | 2021-11-08 15:28:52,330 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:28:52,330 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:28:52,331 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:17 UTC)" executed successfully gcworker stdout | 2021-11-08 15:28:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:22 UTC)" (scheduled at 2021-11-08 15:28:52.617060+00:00) gcworker stdout | 2021-11-08 15:28:52,631 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:28:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:54 UTC)" (scheduled at 2021-11-08 15:28:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:28:54,185 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:28:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:55 UTC)" (scheduled at 2021-11-08 15:28:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:28:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:29:55 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:28:59,775 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:28:59 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:28:59 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.015 1690 0.014) notificationworker stdout | 2021-11-08 15:29:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:10 UTC)" (scheduled at 2021-11-08 15:29:00.322052+00:00) notificationworker stdout | 2021-11-08 15:29:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:29:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:06 UTC)" (scheduled at 2021-11-08 15:29:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:29:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:29:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:09 UTC)" (scheduled at 2021-11-08 15:29:09.376681+00:00) notificationworker stdout | 2021-11-08 15:29:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:29:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:20 UTC)" (scheduled at 2021-11-08 15:29:10.322052+00:00) notificationworker stdout | 2021-11-08 15:29:10,355 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:29:11 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:29:11,541 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:29:11 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:29:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:16 UTC)" (scheduled at 2021-11-08 15:29:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:29:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:29:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:47 UTC)" (scheduled at 2021-11-08 15:29:17.787050+00:00) securityworker stdout | 2021-11-08 15:29:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:29:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 15:29:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 3-43 securityworker stdout | 2021-11-08 15:29:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:29:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 111-151 securityworker stdout | 2021-11-08 15:29:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 15:29:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:29:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 43-83 securityworker stdout | 2021-11-08 15:29:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 15:29:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 15:29:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 15:29:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 223-263 securityworker stdout | 2021-11-08 15:29:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 336-376 securityworker stdout | 2021-11-08 15:29:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 392-432 securityworker stdout | 2021-11-08 15:29:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 295-335 securityworker stdout | 2021-11-08 15:29:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 15:29:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 432-464 securityworker stdout | 2021-11-08 15:29:17,862 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:29:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 15:29:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 15:29:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 7-47 securityworker stdout | 2021-11-08 15:29:17,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:29:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 145-185 securityworker stdout | 2021-11-08 15:29:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 15:29:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 286-326 securityworker stdout | 2021-11-08 15:29:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 15:29:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 15:29:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 204-244 securityworker stdout | 2021-11-08 15:29:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 382-422 securityworker stdout | 2021-11-08 15:29:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 185-225 securityworker stdout | 2021-11-08 15:29:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 15:29:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 446-464 securityworker stdout | 2021-11-08 15:29:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 15:29:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 15:29:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 15:29:17,901 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:29:17,909 [102] [INFO] [util.migrate.allocator] Found 34 candidates, processing block gunicorn-registry stdout | 2021-11-08 15:29:18,498 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:29:18 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:29:18 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.001) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:29:19 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:29:19,447 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:29:19 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:29:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:30 UTC)" (scheduled at 2021-11-08 15:29:20.322052+00:00) notificationworker stdout | 2021-11-08 15:29:20,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:29:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:51 UTC)" (scheduled at 2021-11-08 15:29:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:29:21,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:29:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:52 UTC)" (scheduled at 2021-11-08 15:29:22.617060+00:00) gcworker stdout | 2021-11-08 15:29:22,645 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:52 UTC)" executed successfully securityworker stdout | 2021-11-08 15:29:25,178 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:29:25,178 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:29:25,179 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:29:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:29:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:27 UTC)" (scheduled at 2021-11-08 15:29:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:29:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:29:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:40 UTC)" (scheduled at 2021-11-08 15:29:30.322052+00:00) notificationworker stdout | 2021-11-08 15:29:30,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:29:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:50 UTC)" (scheduled at 2021-11-08 15:29:40.322052+00:00) notificationworker stdout | 2021-11-08 15:29:40,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:29:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:29:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:17 UTC)" (scheduled at 2021-11-08 15:29:47.787050+00:00) securityworker stdout | 2021-11-08 15:29:47,810 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 15:29:47,812 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 15:29:47,814 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 15:29:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:29:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 15:29:47,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 15:29:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 15:29:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 15:29:47,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 245-285 securityworker stdout | 2021-11-08 15:29:47,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 15:29:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 332-372 securityworker stdout | 2021-11-08 15:29:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:29:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 15:29:47,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 15:29:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 15:29:47,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:29:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 435-464 securityworker stdout | 2021-11-08 15:29:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 15:29:47,846 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:29:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 15:29:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:29:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 15:29:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 15:29:47,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 15:29:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 15:29:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:29:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:29:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:29:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 15:29:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:29:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 15:29:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 15:29:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 362-402 securityworker stdout | 2021-11-08 15:29:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 442-464 securityworker stdout | 2021-11-08 15:29:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 15:29:47,880 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:29:47,888 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:29:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:00 UTC)" (scheduled at 2021-11-08 15:29:50.322052+00:00) notificationworker stdout | 2021-11-08 15:29:50,340 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:29:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:50 UTC)" (scheduled at 2021-11-08 15:29:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:29:50,408 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:29:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:21 UTC)" (scheduled at 2021-11-08 15:29:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:29:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:29:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:22 UTC)" (scheduled at 2021-11-08 15:29:52.617060+00:00) gcworker stdout | 2021-11-08 15:29:52,647 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:29:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:54 UTC)" (scheduled at 2021-11-08 15:29:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:29:54,184 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:54 UTC)" executed successfully securityworker stdout | 2021-11-08 15:29:55,073 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:29:55,073 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:29:55,074 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:17 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:29:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:55 UTC)" (scheduled at 2021-11-08 15:29:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:29:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:30:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:30:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:10 UTC)" (scheduled at 2021-11-08 15:30:00.322052+00:00) notificationworker stdout | 2021-11-08 15:30:00,333 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:30:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:06 UTC)" (scheduled at 2021-11-08 15:30:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:30:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:30:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:09 UTC)" (scheduled at 2021-11-08 15:30:09.376681+00:00) notificationworker stdout | 2021-11-08 15:30:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:30:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:20 UTC)" (scheduled at 2021-11-08 15:30:10.322052+00:00) notificationworker stdout | 2021-11-08 15:30:10,351 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:30:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:16 UTC)" (scheduled at 2021-11-08 15:30:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:30:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:30:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:47 UTC)" (scheduled at 2021-11-08 15:30:17.787050+00:00) securityworker stdout | 2021-11-08 15:30:17,815 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 415-455 securityworker stdout | 2021-11-08 15:30:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 15-55 securityworker stdout | 2021-11-08 15:30:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:30:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 123-163 securityworker stdout | 2021-11-08 15:30:17,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 15:30:17,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 55-95 securityworker stdout | 2021-11-08 15:30:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 15:30:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 15:30:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 369-409 securityworker stdout | 2021-11-08 15:30:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 327-367 securityworker stdout | 2021-11-08 15:30:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 15:30:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 15:30:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 15:30:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 15:30:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:30:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 15:30:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 15:30:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 455-464 securityworker stdout | 2021-11-08 15:30:17,861 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:30:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 321-361 securityworker stdout | 2021-11-08 15:30:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 15:30:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:30:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 15:30:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 15:30:17,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 88-128 securityworker stdout | 2021-11-08 15:30:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:30:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 180-220 securityworker stdout | 2021-11-08 15:30:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 82-122 securityworker stdout | 2021-11-08 15:30:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 268-308 securityworker stdout | 2021-11-08 15:30:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 15:30:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 226-266 securityworker stdout | 2021-11-08 15:30:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 15:30:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 15:30:17,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 404-444 securityworker stdout | 2021-11-08 15:30:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 266-306 securityworker stdout | 2021-11-08 15:30:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 361-401 securityworker stdout | 2021-11-08 15:30:17,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 401-441 securityworker stdout | 2021-11-08 15:30:17,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 444-464 securityworker stdout | 2021-11-08 15:30:17,905 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:30:17,913 [102] [INFO] [util.migrate.allocator] Found 38 candidates, processing block notificationworker stdout | 2021-11-08 15:30:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:30 UTC)" (scheduled at 2021-11-08 15:30:20.322052+00:00) notificationworker stdout | 2021-11-08 15:30:20,354 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:30:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:51 UTC)" (scheduled at 2021-11-08 15:30:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:30:21,836 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:30:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:52 UTC)" (scheduled at 2021-11-08 15:30:22.617060+00:00) gcworker stdout | 2021-11-08 15:30:22,660 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:52 UTC)" executed successfully securityworker stdout | 2021-11-08 15:30:24,124 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:30:24,125 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:30:24,126 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:30:47 UTC)" executed successfully repositoryactioncounter stdout | 2021-11-08 15:30:24,130 [88] [INFO] [apscheduler.executors.default] Running job "RepositoryActionCountWorker._run_counting (trigger: interval[4:00:00], next run at: 2021-11-08 15:30:24 UTC)" (scheduled at 2021-11-08 15:30:24.129263+00:00) repositoryactioncounter stdout | 2021-11-08 15:30:24,176 [88] [INFO] [apscheduler.executors.default] Job "RepositoryActionCountWorker._run_counting (trigger: interval[4:00:00], next run at: 2021-11-08 19:30:24 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:30:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:27 UTC)" (scheduled at 2021-11-08 15:30:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:30:27,914 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:30:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:40 UTC)" (scheduled at 2021-11-08 15:30:30.322052+00:00) notificationworker stdout | 2021-11-08 15:30:30,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:30:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:50 UTC)" (scheduled at 2021-11-08 15:30:40.322052+00:00) notificationworker stdout | 2021-11-08 15:30:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:30:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:30:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:17 UTC)" (scheduled at 2021-11-08 15:30:47.787050+00:00) securityworker stdout | 2021-11-08 15:30:47,811 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 15:30:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:30:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 15:30:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 81-121 securityworker stdout | 2021-11-08 15:30:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 15:30:47,823 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 15:30:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 15:30:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:30:47,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:30:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 15:30:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 15:30:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:30:47,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 457-464 securityworker stdout | 2021-11-08 15:30:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 15:30:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 15:30:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 121-161 securityworker stdout | 2021-11-08 15:30:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 15:30:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 15:30:47,860 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:30:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 15:30:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 10-50 securityworker stdout | 2021-11-08 15:30:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 15:30:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 15:30:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 15:30:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 15:30:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 15:30:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 169-209 securityworker stdout | 2021-11-08 15:30:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:30:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:30:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 328-368 securityworker stdout | 2021-11-08 15:30:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 15:30:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 15:30:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:30:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 370-410 securityworker stdout | 2021-11-08 15:30:47,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:30:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 15:30:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:30:47,903 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:30:48,130 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 15:30:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:35:49 UTC)" (scheduled at 2021-11-08 15:30:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 15:30:49,458 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:35:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:30:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:00 UTC)" (scheduled at 2021-11-08 15:30:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 15:30:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:50 UTC)" (scheduled at 2021-11-08 15:30:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:30:50,506 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:50 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:30:50,514 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:00 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:30:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:21 UTC)" (scheduled at 2021-11-08 15:30:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:30:51,832 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:21 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:30:52 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 15:30:52,613 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:30:52 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gcworker stdout | 2021-11-08 15:30:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:22 UTC)" (scheduled at 2021-11-08 15:30:52.617060+00:00) gcworker stdout | 2021-11-08 15:30:52,682 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:30:54,170 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:54 UTC)" (scheduled at 2021-11-08 15:30:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:30:54,194 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:30:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:55 UTC)" (scheduled at 2021-11-08 15:30:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:30:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:31:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:31:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:10 UTC)" (scheduled at 2021-11-08 15:31:00.322052+00:00) notificationworker stdout | 2021-11-08 15:31:00,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:31:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:31:04,986 [242] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:31:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:31:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:06 UTC)" (scheduled at 2021-11-08 15:31:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:31:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:31:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:09 UTC)" (scheduled at 2021-11-08 15:31:09.376681+00:00) notificationworker stdout | 2021-11-08 15:31:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:31:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:20 UTC)" (scheduled at 2021-11-08 15:31:10.322052+00:00) notificationworker stdout | 2021-11-08 15:31:10,526 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:31:12 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.004 228 0.004) gunicorn-registry stdout | 2021-11-08 15:31:12,334 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:31:12 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:31:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:16 UTC)" (scheduled at 2021-11-08 15:31:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:31:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:31:17,787 [102] [WARNING] [apscheduler.scheduler] Execution of job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:17 UTC)" skipped: maximum number of running instances reached (1) notificationworker stdout | 2021-11-08 15:31:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:30 UTC)" (scheduled at 2021-11-08 15:31:20.322052+00:00) notificationworker stdout | 2021-11-08 15:31:20,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:31:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:51 UTC)" (scheduled at 2021-11-08 15:31:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:31:21,814 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:31:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:52 UTC)" (scheduled at 2021-11-08 15:31:22.617060+00:00) gcworker stdout | 2021-11-08 15:31:22,849 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:31:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:27 UTC)" (scheduled at 2021-11-08 15:31:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:31:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:31:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:40 UTC)" (scheduled at 2021-11-08 15:31:30.322052+00:00) notificationworker stdout | 2021-11-08 15:31:30,376 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:40 UTC)" executed successfully securityworker stdout | 2021-11-08 15:31:31,214 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:31:31,214 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:31:31,215 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:31:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:31:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:50 UTC)" (scheduled at 2021-11-08 15:31:40.322052+00:00) notificationworker stdout | 2021-11-08 15:31:40,371 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:31:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:31:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:17 UTC)" (scheduled at 2021-11-08 15:31:47.787050+00:00) securityworker stdout | 2021-11-08 15:31:48,500 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 341-381 securityworker stdout | 2021-11-08 15:31:48,504 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 15:31:48,506 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:31:48,509 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:31:48,511 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 15:31:48,513 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 297-337 securityworker stdout | 2021-11-08 15:31:48,515 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:31:48,519 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 81-121 securityworker stdout | 2021-11-08 15:31:48,522 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:31:48,525 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 222-262 securityworker stdout | 2021-11-08 15:31:48,527 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 15:31:48,531 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 137-177 securityworker stdout | 2021-11-08 15:31:48,534 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 177-217 securityworker stdout | 2021-11-08 15:31:48,537 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 121-161 securityworker stdout | 2021-11-08 15:31:48,539 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 397-437 securityworker stdout | 2021-11-08 15:31:48,542 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 381-421 securityworker stdout | 2021-11-08 15:31:48,545 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 437-464 securityworker stdout | 2021-11-08 15:31:48,545 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:31:48,550 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 33-73 securityworker stdout | 2021-11-08 15:31:48,553 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:31:48,556 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 15:31:48,558 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:31:48,561 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 188-228 securityworker stdout | 2021-11-08 15:31:48,564 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 358-398 securityworker stdout | 2021-11-08 15:31:48,566 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 15:31:48,569 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 85-125 securityworker stdout | 2021-11-08 15:31:48,571 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 142-182 securityworker stdout | 2021-11-08 15:31:48,574 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 182-222 securityworker stdout | 2021-11-08 15:31:48,577 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 73-113 securityworker stdout | 2021-11-08 15:31:48,579 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 228-268 securityworker stdout | 2021-11-08 15:31:48,582 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 301-341 securityworker stdout | 2021-11-08 15:31:48,584 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 15:31:48,587 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 410-450 securityworker stdout | 2021-11-08 15:31:48,589 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 450-464 securityworker stdout | 2021-11-08 15:31:48,592 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:31:48,592 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:31:48,668 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:31:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:00 UTC)" (scheduled at 2021-11-08 15:31:50.322052+00:00) notificationworker stdout | 2021-11-08 15:31:50,383 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:31:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:50 UTC)" (scheduled at 2021-11-08 15:31:50.393684+00:00) nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:31:50 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.002) gunicorn-registry stdout | 2021-11-08 15:31:50,494 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:31:50 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:31:50,583 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:31:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:21 UTC)" (scheduled at 2021-11-08 15:31:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:31:52,255 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:31:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:22 UTC)" (scheduled at 2021-11-08 15:31:52.617060+00:00) gcworker stdout | 2021-11-08 15:31:52,702 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:31:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:54 UTC)" (scheduled at 2021-11-08 15:31:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:31:54,190 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:31:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:55 UTC)" (scheduled at 2021-11-08 15:31:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:31:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:32:55 UTC)" executed successfully securityworker stdout | 2021-11-08 15:31:55,795 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:31:55,795 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:31:55,796 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:32:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:10 UTC)" (scheduled at 2021-11-08 15:32:00.322052+00:00) notificationworker stdout | 2021-11-08 15:32:00,364 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:32:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.002 228 0.002) gunicorn-registry stdout | 2021-11-08 15:32:04,574 [245] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:32:04 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:32:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:06 UTC)" (scheduled at 2021-11-08 15:32:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:32:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:32:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:09 UTC)" (scheduled at 2021-11-08 15:32:09.376681+00:00) notificationworker stdout | 2021-11-08 15:32:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:32:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:20 UTC)" (scheduled at 2021-11-08 15:32:10.322052+00:00) notificationworker stdout | 2021-11-08 15:32:10,902 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:32:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:16 UTC)" (scheduled at 2021-11-08 15:32:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:32:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:32:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:47 UTC)" (scheduled at 2021-11-08 15:32:17.787050+00:00) securityworker stdout | 2021-11-08 15:32:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:32:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 150-190 securityworker stdout | 2021-11-08 15:32:17,842 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 15:32:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:32:17,847 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 218-258 securityworker stdout | 2021-11-08 15:32:17,928 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 15:32:17,932 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 15:32:17,935 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 372-412 securityworker stdout | 2021-11-08 15:32:17,938 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:32:17,941 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:32:17,944 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 15:32:17,947 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 271-311 securityworker stdout | 2021-11-08 15:32:17,949 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 127-167 securityworker stdout | 2021-11-08 15:32:17,951 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 311-351 securityworker stdout | 2021-11-08 15:32:17,953 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 258-298 securityworker stdout | 2021-11-08 15:32:17,956 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 456-464 securityworker stdout | 2021-11-08 15:32:17,959 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:32:17,959 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:32:17,962 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 15:32:17,965 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 381-421 securityworker stdout | 2021-11-08 15:32:17,968 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 276-316 securityworker stdout | 2021-11-08 15:32:17,970 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 15:32:17,973 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 15:32:17,976 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 15:32:17,978 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 17-57 securityworker stdout | 2021-11-08 15:32:17,980 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 57-97 securityworker stdout | 2021-11-08 15:32:17,982 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 15:32:17,985 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 365-405 securityworker stdout | 2021-11-08 15:32:17,987 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:32:17,990 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 201-241 securityworker stdout | 2021-11-08 15:32:17,992 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 241-281 securityworker stdout | 2021-11-08 15:32:17,995 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 194-234 securityworker stdout | 2021-11-08 15:32:17,997 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 15:32:17,999 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 15:32:18,002 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 421-461 securityworker stdout | 2021-11-08 15:32:18,004 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 461-464 securityworker stdout | 2021-11-08 15:32:18,004 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:32:18,103 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:32:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:30 UTC)" (scheduled at 2021-11-08 15:32:20.322052+00:00) notificationworker stdout | 2021-11-08 15:32:20,372 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:32:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:51 UTC)" (scheduled at 2021-11-08 15:32:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:32:21,979 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:32:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:52 UTC)" (scheduled at 2021-11-08 15:32:22.617060+00:00) gcworker stdout | 2021-11-08 15:32:22,644 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:52 UTC)" executed successfully securityworker stdout | 2021-11-08 15:32:23,947 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:32:23,948 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:32:23,949 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:32:47 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:32:27 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:32:27,337 [241] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:32:27 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:32:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:27 UTC)" (scheduled at 2021-11-08 15:32:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:32:27,902 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:32:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:40 UTC)" (scheduled at 2021-11-08 15:32:30.322052+00:00) notificationworker stdout | 2021-11-08 15:32:30,651 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:32:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:50 UTC)" (scheduled at 2021-11-08 15:32:40.322052+00:00) notificationworker stdout | 2021-11-08 15:32:40,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:32:50 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:32:46,131 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:37:46 UTC)" (scheduled at 2021-11-08 15:32:46.131205+00:00) namespacegcworker stdout | 2021-11-08 15:32:47,045 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:37:46 UTC)" executed successfully securityworker stdout | 2021-11-08 15:32:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:17 UTC)" (scheduled at 2021-11-08 15:32:47.787050+00:00) securityworker stdout | 2021-11-08 15:32:48,076 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 25-65 securityworker stdout | 2021-11-08 15:32:48,079 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:32:48,081 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 119-159 securityworker stdout | 2021-11-08 15:32:48,083 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 76-116 securityworker stdout | 2021-11-08 15:32:48,085 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 15:32:48,087 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:32:48,089 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 163-203 securityworker stdout | 2021-11-08 15:32:48,091 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 203-243 securityworker stdout | 2021-11-08 15:32:48,093 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 159-199 securityworker stdout | 2021-11-08 15:32:48,095 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:32:48,097 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:32:48,099 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 15:32:48,102 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 309-349 securityworker stdout | 2021-11-08 15:32:48,104 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 349-389 securityworker stdout | 2021-11-08 15:32:48,107 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 246-286 securityworker stdout | 2021-11-08 15:32:48,110 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 15:32:48,112 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 15:32:48,114 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 305-345 securityworker stdout | 2021-11-08 15:32:48,116 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 15:32:48,116 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:32:48,119 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 204-244 securityworker stdout | 2021-11-08 15:32:48,121 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 59-99 securityworker stdout | 2021-11-08 15:32:48,123 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 15:32:48,125 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:32:48,127 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 136-176 securityworker stdout | 2021-11-08 15:32:48,134 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 99-139 securityworker stdout | 2021-11-08 15:32:48,137 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:32:48,139 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 176-216 securityworker stdout | 2021-11-08 15:32:48,142 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 319-359 securityworker stdout | 2021-11-08 15:32:48,144 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 391-431 securityworker stdout | 2021-11-08 15:32:48,147 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 359-399 securityworker stdout | 2021-11-08 15:32:48,149 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 278-318 securityworker stdout | 2021-11-08 15:32:48,151 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 15:32:48,154 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 431-464 securityworker stdout | 2021-11-08 15:32:48,156 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 244-284 securityworker stdout | 2021-11-08 15:32:48,156 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:32:48,164 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:32:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:00 UTC)" (scheduled at 2021-11-08 15:32:50.322052+00:00) exportactionlogsworker stdout | 2021-11-08 15:32:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:50 UTC)" (scheduled at 2021-11-08 15:32:50.393684+00:00) notificationworker stdout | 2021-11-08 15:32:50,775 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:32:50,781 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:32:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:21 UTC)" (scheduled at 2021-11-08 15:32:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:32:51,917 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:21 UTC)" executed successfully securityworker stdout | 2021-11-08 15:32:52,071 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:32:52,071 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:32:52,072 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:32:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:37:52 UTC)" (scheduled at 2021-11-08 15:32:52.376404+00:00) gcworker stdout | 2021-11-08 15:32:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:22 UTC)" (scheduled at 2021-11-08 15:32:52.617060+00:00) notificationworker stdout | 2021-11-08 15:32:52,683 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:37:52 UTC)" executed successfully gcworker stdout | 2021-11-08 15:32:52,684 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:32:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:54 UTC)" (scheduled at 2021-11-08 15:32:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:32:54,182 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:32:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:55 UTC)" (scheduled at 2021-11-08 15:32:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:32:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:33:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:32:55 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.267 325 0.267) gunicorn-registry stdout | 2021-11-08 15:32:55,784 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:32:55 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:32:56 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.091 325 0.090) gunicorn-registry stdout | 2021-11-08 15:32:56,496 [237] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:32:56 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:33:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:10 UTC)" (scheduled at 2021-11-08 15:33:00.322052+00:00) notificationworker stdout | 2021-11-08 15:33:00,385 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:33:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:06 UTC)" (scheduled at 2021-11-08 15:33:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:33:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:06 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:33:07,128 [244] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:33:07 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:33:07 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.474 325 0.473) notificationworker stdout | 2021-11-08 15:33:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:09 UTC)" (scheduled at 2021-11-08 15:33:09.376681+00:00) notificationworker stdout | 2021-11-08 15:33:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:33:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:20 UTC)" (scheduled at 2021-11-08 15:33:10.322052+00:00) notificationworker stdout | 2021-11-08 15:33:10,342 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:33:14,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:38:14 UTC)" (scheduled at 2021-11-08 15:33:14.905355+00:00) repositorygcworker stdout | 2021-11-08 15:33:15,266 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:38:14 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:33:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:16 UTC)" (scheduled at 2021-11-08 15:33:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:33:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:33:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:47 UTC)" (scheduled at 2021-11-08 15:33:17.787050+00:00) securityworker stdout | 2021-11-08 15:33:17,918 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 63-103 securityworker stdout | 2021-11-08 15:33:17,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 21-61 securityworker stdout | 2021-11-08 15:33:17,925 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 15:33:17,927 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:33:17,930 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 15:33:17,932 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 114-154 securityworker stdout | 2021-11-08 15:33:17,934 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 190-230 securityworker stdout | 2021-11-08 15:33:17,936 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 15:33:17,938 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 15:33:17,940 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 154-194 securityworker stdout | 2021-11-08 15:33:17,943 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 15:33:17,946 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 287-327 securityworker stdout | 2021-11-08 15:33:17,948 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 377-417 securityworker stdout | 2021-11-08 15:33:17,950 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 15:33:17,952 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 417-457 securityworker stdout | 2021-11-08 15:33:17,955 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 15:33:17,957 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 337-377 securityworker stdout | 2021-11-08 15:33:17,960 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 336-376 securityworker stdout | 2021-11-08 15:33:17,960 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:33:17,962 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 125-165 securityworker stdout | 2021-11-08 15:33:17,965 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 15:33:17,967 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:33:17,969 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 348-388 securityworker stdout | 2021-11-08 15:33:17,972 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 221-261 securityworker stdout | 2021-11-08 15:33:17,974 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 15:33:17,976 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 166-206 securityworker stdout | 2021-11-08 15:33:17,979 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 206-246 securityworker stdout | 2021-11-08 15:33:17,982 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 165-205 securityworker stdout | 2021-11-08 15:33:17,984 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 15:33:17,986 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 261-301 securityworker stdout | 2021-11-08 15:33:17,989 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 15:33:17,991 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 15:33:17,993 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 430-464 securityworker stdout | 2021-11-08 15:33:17,996 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 84-124 securityworker stdout | 2021-11-08 15:33:17,997 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:33:17,999 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 15:33:18,000 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:33:18,009 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block gunicorn-registry stdout | 2021-11-08 15:33:19,044 [241] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:33:19 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:33:19 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.094 325 0.094) nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:33:19 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.334 325 0.333) gunicorn-registry stdout | 2021-11-08 15:33:19,641 [243] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:33:19 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" notificationworker stdout | 2021-11-08 15:33:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:30 UTC)" (scheduled at 2021-11-08 15:33:20.322052+00:00) notificationworker stdout | 2021-11-08 15:33:20,461 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:33:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:51 UTC)" (scheduled at 2021-11-08 15:33:21.793811+00:00) gcworker stdout | 2021-11-08 15:33:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:52 UTC)" (scheduled at 2021-11-08 15:33:22.617060+00:00) buildlogsarchiver stdout | 2021-11-08 15:33:22,780 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:51 UTC)" executed successfully securityworker stdout | 2021-11-08 15:33:22,785 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:33:22,785 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:33:22,786 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:47 UTC)" executed successfully gcworker stdout | 2021-11-08 15:33:23,104 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:33:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:33:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:27 UTC)" (scheduled at 2021-11-08 15:33:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:33:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:33:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:40 UTC)" (scheduled at 2021-11-08 15:33:30.322052+00:00) notificationworker stdout | 2021-11-08 15:33:30,593 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:40 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:33:37,611 [230] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:33:37 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:33:37 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.083 325 0.083) notificationworker stdout | 2021-11-08 15:33:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:50 UTC)" (scheduled at 2021-11-08 15:33:40.322052+00:00) notificationworker stdout | 2021-11-08 15:33:40,488 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:33:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:33:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:17 UTC)" (scheduled at 2021-11-08 15:33:47.787050+00:00) securityworker stdout | 2021-11-08 15:33:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 15:33:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 95-135 securityworker stdout | 2021-11-08 15:33:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 135-175 securityworker stdout | 2021-11-08 15:33:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 338-378 securityworker stdout | 2021-11-08 15:33:47,875 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 15:33:47,964 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:33:47,974 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:33:47,980 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:33:47,986 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 15:33:47,993 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:33:48,007 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 378-418 securityworker stdout | 2021-11-08 15:33:48,019 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 435-464 securityworker stdout | 2021-11-08 15:33:48,027 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 225-265 securityworker stdout | 2021-11-08 15:33:48,033 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 284-324 securityworker stdout | 2021-11-08 15:33:48,047 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 212-252 securityworker stdout | 2021-11-08 15:33:48,057 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 324-364 securityworker stdout | 2021-11-08 15:33:48,068 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 265-305 securityworker stdout | 2021-11-08 15:33:48,068 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:33:48,075 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 412-452 securityworker stdout | 2021-11-08 15:33:48,081 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 296-336 securityworker stdout | 2021-11-08 15:33:48,088 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:33:48,098 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 351-391 securityworker stdout | 2021-11-08 15:33:48,106 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 391-431 securityworker stdout | 2021-11-08 15:33:48,109 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 336-376 securityworker stdout | 2021-11-08 15:33:48,117 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:33:48,129 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 50-90 securityworker stdout | 2021-11-08 15:33:48,137 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 15:33:48,151 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 15:33:48,165 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 15:33:48,172 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:33:48,176 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:33:48,186 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 15:33:48,194 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 90-130 securityworker stdout | 2021-11-08 15:33:48,201 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 15:33:48,209 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 452-464 securityworker stdout | 2021-11-08 15:33:48,209 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:33:48,221 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:33:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:00 UTC)" (scheduled at 2021-11-08 15:33:50.322052+00:00) notificationworker stdout | 2021-11-08 15:33:50,342 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:33:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:50 UTC)" (scheduled at 2021-11-08 15:33:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:33:50,411 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:33:51,137 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:33:51,137 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:33:51,138 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:17 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:33:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:21 UTC)" (scheduled at 2021-11-08 15:33:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:33:52,058 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:33:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:22 UTC)" (scheduled at 2021-11-08 15:33:52.617060+00:00) gcworker stdout | 2021-11-08 15:33:52,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:33:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:54 UTC)" (scheduled at 2021-11-08 15:33:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:33:54,186 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:33:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:55 UTC)" (scheduled at 2021-11-08 15:33:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:33:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:34:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:34:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:10 UTC)" (scheduled at 2021-11-08 15:34:00.322052+00:00) notificationworker stdout | 2021-11-08 15:34:00,357 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:10 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:34:05,828 [241] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:34:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:34:05 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.137 325 0.137) exportactionlogsworker stdout | 2021-11-08 15:34:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:06 UTC)" (scheduled at 2021-11-08 15:34:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:34:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:34:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:09 UTC)" (scheduled at 2021-11-08 15:34:09.376681+00:00) notificationworker stdout | 2021-11-08 15:34:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:34:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:20 UTC)" (scheduled at 2021-11-08 15:34:10.322052+00:00) notificationworker stdout | 2021-11-08 15:34:10,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:20 UTC)" executed successfully gunicorn-registry stdout | 2021-11-08 15:34:12,778 [231] [INFO] [gunicorn.access] 10.100.102.3 - c17744 [08/Nov/2021:15:34:12 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - c17744 [08/Nov/2021:15:34:12 +0000] "GET /v2/auth?account=c17744&scope=repository%3Ac17744%2Ftest_custom%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 200 1021 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.254 325 0.254) gunicorn-registry stdout | 2021-11-08 15:34:15,420 [235] [ERROR] [util.http] Error 401: Anonymous access is not allowed; Arguments: {'url': 'https://enterprisequay.rblbank.com/v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com', 'status_code': 401, 'message': 'Anonymous access is not allowed'} nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:34:15 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" (0.003 272 0.003) gunicorn-registry stdout | 2021-11-08 15:34:15,422 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:34:15 +0000] "GET /v2/auth?scope=repository%3Afinacle10225%2Fisogateway%3Apull&service=enterprisequay.rblbank.com HTTP/1.1" 401 44 "-" "cri-o/1.20.2-6.rhaos4.7.gitf1d5201.el8 go/go1.15.7 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:34:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:16 UTC)" (scheduled at 2021-11-08 15:34:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:34:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:34:17,791 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:47 UTC)" (scheduled at 2021-11-08 15:34:17.787050+00:00) securityworker stdout | 2021-11-08 15:34:17,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 65-105 securityworker stdout | 2021-11-08 15:34:17,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 4-44 securityworker stdout | 2021-11-08 15:34:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 44-84 securityworker stdout | 2021-11-08 15:34:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:34:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 318-358 securityworker stdout | 2021-11-08 15:34:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 358-398 securityworker stdout | 2021-11-08 15:34:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 409-449 securityworker stdout | 2021-11-08 15:34:17,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 200-240 securityworker stdout | 2021-11-08 15:34:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 398-438 securityworker stdout | 2021-11-08 15:34:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 259-299 securityworker stdout | 2021-11-08 15:34:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 240-280 securityworker stdout | 2021-11-08 15:34:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 299-339 securityworker stdout | 2021-11-08 15:34:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 449-464 securityworker stdout | 2021-11-08 15:34:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 147-187 securityworker stdout | 2021-11-08 15:34:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 107-147 securityworker stdout | 2021-11-08 15:34:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 105-145 securityworker stdout | 2021-11-08 15:34:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 187-227 securityworker stdout | 2021-11-08 15:34:17,860 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:34:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 350-390 securityworker stdout | 2021-11-08 15:34:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 115-155 securityworker stdout | 2021-11-08 15:34:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 15:34:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 283-323 securityworker stdout | 2021-11-08 15:34:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 323-363 securityworker stdout | 2021-11-08 15:34:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 155-195 securityworker stdout | 2021-11-08 15:34:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 216-256 securityworker stdout | 2021-11-08 15:34:17,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 28-68 securityworker stdout | 2021-11-08 15:34:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:34:17,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 256-296 securityworker stdout | 2021-11-08 15:34:17,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:34:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 405-445 securityworker stdout | 2021-11-08 15:34:17,897 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 390-430 securityworker stdout | 2021-11-08 15:34:17,899 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 445-464 securityworker stdout | 2021-11-08 15:34:17,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 69-109 securityworker stdout | 2021-11-08 15:34:17,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 68-108 securityworker stdout | 2021-11-08 15:34:17,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 109-149 securityworker stdout | 2021-11-08 15:34:17,907 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:34:17,915 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:34:19,422 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:34:19,423 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:34:19,423 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:47 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:34:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:30 UTC)" (scheduled at 2021-11-08 15:34:20.322052+00:00) notificationworker stdout | 2021-11-08 15:34:20,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:34:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:51 UTC)" (scheduled at 2021-11-08 15:34:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:34:21,814 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:34:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:52 UTC)" (scheduled at 2021-11-08 15:34:22.617060+00:00) gcworker stdout | 2021-11-08 15:34:22,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:34:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:34:25 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:34:25,499 [235] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:34:25 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" gunicorn-registry stdout | 2021-11-08 15:34:25,664 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:34:25 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:34:25 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.016 1690 0.016) namespacegcworker stdout | 2021-11-08 15:34:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:27 UTC)" (scheduled at 2021-11-08 15:34:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:34:27,899 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:34:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:40 UTC)" (scheduled at 2021-11-08 15:34:30.322052+00:00) notificationworker stdout | 2021-11-08 15:34:30,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:34:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:50 UTC)" (scheduled at 2021-11-08 15:34:40.322052+00:00) notificationworker stdout | 2021-11-08 15:34:40,342 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:34:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:34:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:17 UTC)" (scheduled at 2021-11-08 15:34:47.787050+00:00) securityworker stdout | 2021-11-08 15:34:47,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 373-413 securityworker stdout | 2021-11-08 15:34:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 15:34:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:34:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 15:34:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:34:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 15:34:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 15:34:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 11-51 securityworker stdout | 2021-11-08 15:34:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:34:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 51-91 securityworker stdout | 2021-11-08 15:34:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 146-186 securityworker stdout | 2021-11-08 15:34:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 96-136 securityworker stdout | 2021-11-08 15:34:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 230-270 securityworker stdout | 2021-11-08 15:34:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:34:47,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 314-354 securityworker stdout | 2021-11-08 15:34:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 274-314 securityworker stdout | 2021-11-08 15:34:47,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:34:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 354-394 securityworker stdout | 2021-11-08 15:34:47,871 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:34:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 276-316 securityworker stdout | 2021-11-08 15:34:47,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 215-255 securityworker stdout | 2021-11-08 15:34:47,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 255-295 securityworker stdout | 2021-11-08 15:34:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 66-106 securityworker stdout | 2021-11-08 15:34:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 20-60 securityworker stdout | 2021-11-08 15:34:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:34:47,890 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 130-170 securityworker stdout | 2021-11-08 15:34:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 15:34:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 60-100 securityworker stdout | 2021-11-08 15:34:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 15:34:47,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 15:34:47,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 106-146 securityworker stdout | 2021-11-08 15:34:47,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 355-395 securityworker stdout | 2021-11-08 15:34:47,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 316-356 securityworker stdout | 2021-11-08 15:34:47,912 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 398-438 securityworker stdout | 2021-11-08 15:34:47,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 395-435 securityworker stdout | 2021-11-08 15:34:47,917 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 438-464 securityworker stdout | 2021-11-08 15:34:47,918 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:34:47,927 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:34:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:00 UTC)" (scheduled at 2021-11-08 15:34:50.322052+00:00) notificationworker stdout | 2021-11-08 15:34:50,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:00 UTC)" executed successfully securityworker stdout | 2021-11-08 15:34:50,346 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:34:50,347 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:34:50,348 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:17 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:34:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:50 UTC)" (scheduled at 2021-11-08 15:34:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:34:50,409 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:34:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:21 UTC)" (scheduled at 2021-11-08 15:34:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:34:51,808 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:34:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:22 UTC)" (scheduled at 2021-11-08 15:34:52.617060+00:00) gcworker stdout | 2021-11-08 15:34:52,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:34:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:54 UTC)" (scheduled at 2021-11-08 15:34:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:34:54,181 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:34:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:55 UTC)" (scheduled at 2021-11-08 15:34:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:34:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:35:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:35:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:10 UTC)" (scheduled at 2021-11-08 15:35:00.322052+00:00) notificationworker stdout | 2021-11-08 15:35:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:35:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:06 UTC)" (scheduled at 2021-11-08 15:35:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:35:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:35:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:09 UTC)" (scheduled at 2021-11-08 15:35:09.376681+00:00) notificationworker stdout | 2021-11-08 15:35:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:35:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:20 UTC)" (scheduled at 2021-11-08 15:35:10.322052+00:00) notificationworker stdout | 2021-11-08 15:35:10,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:20 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:35:16,907 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:16 UTC)" (scheduled at 2021-11-08 15:35:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:35:16,907 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:35:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:47 UTC)" (scheduled at 2021-11-08 15:35:17.787050+00:00) securityworker stdout | 2021-11-08 15:35:17,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 413-453 securityworker stdout | 2021-11-08 15:35:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 453-464 securityworker stdout | 2021-11-08 15:35:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 31-71 securityworker stdout | 2021-11-08 15:35:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:35:17,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:35:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 356-396 securityworker stdout | 2021-11-08 15:35:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 15:35:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 396-436 securityworker stdout | 2021-11-08 15:35:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 239-279 securityworker stdout | 2021-11-08 15:35:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 15:35:17,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 71-111 securityworker stdout | 2021-11-08 15:35:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 279-319 securityworker stdout | 2021-11-08 15:35:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 196-236 securityworker stdout | 2021-11-08 15:35:17,868 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 236-276 securityworker stdout | 2021-11-08 15:35:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 124-164 securityworker stdout | 2021-11-08 15:35:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 164-204 securityworker stdout | 2021-11-08 15:35:17,877 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 15:35:17,877 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:35:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 251-291 securityworker stdout | 2021-11-08 15:35:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 376-416 securityworker stdout | 2021-11-08 15:35:17,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 313-353 securityworker stdout | 2021-11-08 15:35:17,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 291-331 securityworker stdout | 2021-11-08 15:35:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 15:35:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 5-45 securityworker stdout | 2021-11-08 15:35:17,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 353-393 securityworker stdout | 2021-11-08 15:35:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 209-249 securityworker stdout | 2021-11-08 15:35:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:35:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 45-85 securityworker stdout | 2021-11-08 15:35:17,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 15:35:17,906 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 249-289 securityworker stdout | 2021-11-08 15:35:17,909 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 15:35:17,911 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 15:35:17,913 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 101-141 securityworker stdout | 2021-11-08 15:35:17,915 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 423-463 securityworker stdout | 2021-11-08 15:35:17,919 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 463-464 securityworker stdout | 2021-11-08 15:35:17,922 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 416-456 securityworker stdout | 2021-11-08 15:35:17,922 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:35:17,933 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:35:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:30 UTC)" (scheduled at 2021-11-08 15:35:20.322052+00:00) notificationworker stdout | 2021-11-08 15:35:20,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:30 UTC)" executed successfully securityworker stdout | 2021-11-08 15:35:20,766 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:35:20,767 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:35:20,768 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:35:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:51 UTC)" (scheduled at 2021-11-08 15:35:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:35:21,811 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:35:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:52 UTC)" (scheduled at 2021-11-08 15:35:22.617060+00:00) gcworker stdout | 2021-11-08 15:35:22,637 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:35:52 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:35:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:27 UTC)" (scheduled at 2021-11-08 15:35:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:35:27,902 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:35:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:40 UTC)" (scheduled at 2021-11-08 15:35:30.322052+00:00) notificationworker stdout | 2021-11-08 15:35:30,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:35:40,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:50 UTC)" (scheduled at 2021-11-08 15:35:40.322052+00:00) notificationworker stdout | 2021-11-08 15:35:40,341 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:35:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:35:47,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:17 UTC)" (scheduled at 2021-11-08 15:35:47.787050+00:00) securityworker stdout | 2021-11-08 15:35:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 317-357 securityworker stdout | 2021-11-08 15:35:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:35:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:35:47,826 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 199-239 securityworker stdout | 2021-11-08 15:35:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 15:35:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 406-446 securityworker stdout | 2021-11-08 15:35:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 15:35:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 357-397 securityworker stdout | 2021-11-08 15:35:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 252-292 securityworker stdout | 2021-11-08 15:35:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 292-332 securityworker stdout | 2021-11-08 15:35:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 15:35:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:35:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 15:35:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:35:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 239-279 securityworker stdout | 2021-11-08 15:35:47,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 15:35:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 15:35:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 15:35:47,868 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:35:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 302-342 securityworker stdout | 2021-11-08 15:35:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:35:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:35:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 41-81 securityworker stdout | 2021-11-08 15:35:47,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 15:35:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 171-211 securityworker stdout | 2021-11-08 15:35:47,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 15:35:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 15:35:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 15:35:47,894 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 211-251 securityworker stdout | 2021-11-08 15:35:47,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 367-407 securityworker stdout | 2021-11-08 15:35:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 342-382 securityworker stdout | 2021-11-08 15:35:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 86-126 securityworker stdout | 2021-11-08 15:35:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:35:47,904 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 15:35:47,907 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 15:35:47,907 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:35:47,917 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block exportactionlogsworker stdout | 2021-11-08 15:35:49,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:40:49 UTC)" (scheduled at 2021-11-08 15:35:49.438907+00:00) exportactionlogsworker stdout | 2021-11-08 15:35:49,469 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:40:49 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:35:50,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:00 UTC)" (scheduled at 2021-11-08 15:35:50.322052+00:00) notificationworker stdout | 2021-11-08 15:35:50,355 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:35:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:50 UTC)" (scheduled at 2021-11-08 15:35:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:35:50,472 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:35:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:21 UTC)" (scheduled at 2021-11-08 15:35:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:35:51,813 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:35:52,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:22 UTC)" (scheduled at 2021-11-08 15:35:52.617060+00:00) gcworker stdout | 2021-11-08 15:35:52,640 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:22 UTC)" executed successfully securityworker stdout | 2021-11-08 15:35:53,462 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:35:53,462 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:35:53,464 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:17 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:35:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:54 UTC)" (scheduled at 2021-11-08 15:35:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:35:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:35:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:55 UTC)" (scheduled at 2021-11-08 15:35:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:35:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:36:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:36:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:10 UTC)" (scheduled at 2021-11-08 15:36:00.322052+00:00) notificationworker stdout | 2021-11-08 15:36:00,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:36:06 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.017 1690 0.017) gunicorn-registry stdout | 2021-11-08 15:36:06,035 [244] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:36:06 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" exportactionlogsworker stdout | 2021-11-08 15:36:06,440 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:06 UTC)" (scheduled at 2021-11-08 15:36:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:36:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:36:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:09 UTC)" (scheduled at 2021-11-08 15:36:09.376681+00:00) notificationworker stdout | 2021-11-08 15:36:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:36:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:20 UTC)" (scheduled at 2021-11-08 15:36:10.322052+00:00) notificationworker stdout | 2021-11-08 15:36:10,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:36:16 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.018 1689 0.018) gunicorn-registry stdout | 2021-11-08 15:36:16,121 [243] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:36:16 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-crmcustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:36:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:16 UTC)" (scheduled at 2021-11-08 15:36:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:36:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:36:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:47 UTC)" (scheduled at 2021-11-08 15:36:17.787050+00:00) securityworker stdout | 2021-11-08 15:36:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 139-179 securityworker stdout | 2021-11-08 15:36:17,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 208-248 securityworker stdout | 2021-11-08 15:36:17,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 179-219 securityworker stdout | 2021-11-08 15:36:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 49-89 securityworker stdout | 2021-11-08 15:36:17,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 2-42 securityworker stdout | 2021-11-08 15:36:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 89-129 securityworker stdout | 2021-11-08 15:36:17,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 129-169 securityworker stdout | 2021-11-08 15:36:17,845 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 42-82 securityworker stdout | 2021-11-08 15:36:17,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 300-340 securityworker stdout | 2021-11-08 15:36:17,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:36:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 253-293 securityworker stdout | 2021-11-08 15:36:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 15:36:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:36:17,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 340-380 securityworker stdout | 2021-11-08 15:36:17,863 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 248-288 securityworker stdout | 2021-11-08 15:36:17,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 15:36:17,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 411-451 securityworker stdout | 2021-11-08 15:36:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 15:36:17,869 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:36:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 362-402 securityworker stdout | 2021-11-08 15:36:17,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 407-447 securityworker stdout | 2021-11-08 15:36:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 306-346 securityworker stdout | 2021-11-08 15:36:17,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 402-442 securityworker stdout | 2021-11-08 15:36:17,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 28-68 securityworker stdout | 2021-11-08 15:36:17,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 346-386 securityworker stdout | 2021-11-08 15:36:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 122-162 securityworker stdout | 2021-11-08 15:36:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 235-275 securityworker stdout | 2021-11-08 15:36:17,888 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:36:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 275-315 securityworker stdout | 2021-11-08 15:36:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 195-235 securityworker stdout | 2021-11-08 15:36:17,896 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 15:36:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 68-108 securityworker stdout | 2021-11-08 15:36:17,901 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 15:36:17,903 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 118-158 securityworker stdout | 2021-11-08 15:36:17,905 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 447-464 securityworker stdout | 2021-11-08 15:36:17,905 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:36:17,914 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:36:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:30 UTC)" (scheduled at 2021-11-08 15:36:20.322052+00:00) notificationworker stdout | 2021-11-08 15:36:20,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:30 UTC)" executed successfully securityworker stdout | 2021-11-08 15:36:20,690 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:36:20,690 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:36:20,691 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:47 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:36:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:51 UTC)" (scheduled at 2021-11-08 15:36:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:36:21,809 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:36:22,617 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:52 UTC)" (scheduled at 2021-11-08 15:36:22.617060+00:00) gcworker stdout | 2021-11-08 15:36:22,633 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:36:52 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:36:25 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.014 1690 0.014) gunicorn-registry stdout | 2021-11-08 15:36:25,697 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:36:25 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" namespacegcworker stdout | 2021-11-08 15:36:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:27 UTC)" (scheduled at 2021-11-08 15:36:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:36:27,898 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:36:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:40 UTC)" (scheduled at 2021-11-08 15:36:30.322052+00:00) notificationworker stdout | 2021-11-08 15:36:30,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:36:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:50 UTC)" (scheduled at 2021-11-08 15:36:40.322052+00:00) notificationworker stdout | 2021-11-08 15:36:40,334 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:36:50 UTC)" executed successfully securityworker stdout | 2021-11-08 15:36:47,790 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:17 UTC)" (scheduled at 2021-11-08 15:36:47.787050+00:00) securityworker stdout | 2021-11-08 15:36:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 184-224 securityworker stdout | 2021-11-08 15:36:47,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 233-273 securityworker stdout | 2021-11-08 15:36:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 224-264 securityworker stdout | 2021-11-08 15:36:47,820 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 331-371 securityworker stdout | 2021-11-08 15:36:47,825 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 285-325 securityworker stdout | 2021-11-08 15:36:47,830 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 325-365 securityworker stdout | 2021-11-08 15:36:47,832 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 273-313 securityworker stdout | 2021-11-08 15:36:47,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 388-428 securityworker stdout | 2021-11-08 15:36:47,836 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 371-411 securityworker stdout | 2021-11-08 15:36:47,839 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 128-168 securityworker stdout | 2021-11-08 15:36:47,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 168-208 securityworker stdout | 2021-11-08 15:36:47,843 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 8-48 securityworker stdout | 2021-11-08 15:36:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 62-102 securityworker stdout | 2021-11-08 15:36:47,848 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:36:47,852 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 48-88 securityworker stdout | 2021-11-08 15:36:47,854 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 102-142 securityworker stdout | 2021-11-08 15:36:47,857 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 428-464 securityworker stdout | 2021-11-08 15:36:47,857 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:36:47,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 38-78 securityworker stdout | 2021-11-08 15:36:47,861 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:36:47,865 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 344-384 securityworker stdout | 2021-11-08 15:36:47,867 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 418-458 securityworker stdout | 2021-11-08 15:36:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 384-424 securityworker stdout | 2021-11-08 15:36:47,872 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 458-464 securityworker stdout | 2021-11-08 15:36:47,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 15:36:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 227-267 securityworker stdout | 2021-11-08 15:36:47,880 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 162-202 securityworker stdout | 2021-11-08 15:36:47,883 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 78-118 securityworker stdout | 2021-11-08 15:36:47,885 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 202-242 securityworker stdout | 2021-11-08 15:36:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 15:36:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 267-307 securityworker stdout | 2021-11-08 15:36:47,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 144-184 securityworker stdout | 2021-11-08 15:36:47,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 15:36:47,893 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:36:47,899 [102] [INFO] [util.migrate.allocator] Found 28 candidates, processing block notificationworker stdout | 2021-11-08 15:36:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:00 UTC)" (scheduled at 2021-11-08 15:36:50.322052+00:00) notificationworker stdout | 2021-11-08 15:36:50,343 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:36:50,394 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:50 UTC)" (scheduled at 2021-11-08 15:36:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:36:50,413 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:36:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:21 UTC)" (scheduled at 2021-11-08 15:36:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:36:51,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:21 UTC)" executed successfully gcworker stdout | 2021-11-08 15:36:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:22 UTC)" (scheduled at 2021-11-08 15:36:52.617060+00:00) gcworker stdout | 2021-11-08 15:36:52,638 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:36:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:54 UTC)" (scheduled at 2021-11-08 15:36:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:36:54,185 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:36:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:55 UTC)" (scheduled at 2021-11-08 15:36:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:36:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:37:55 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:36:55 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.081 1690 0.081) gunicorn-registry stdout | 2021-11-08 15:36:55,770 [232] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:36:55 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" securityworker stdout | 2021-11-08 15:36:58,691 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:36:58,691 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:36:58,692 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:37:00,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:10 UTC)" (scheduled at 2021-11-08 15:37:00.322052+00:00) notificationworker stdout | 2021-11-08 15:37:00,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:10 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:37:06,439 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:06 UTC)" (scheduled at 2021-11-08 15:37:06.439220+00:00) exportactionlogsworker stdout | 2021-11-08 15:37:06,440 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:06 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:37:09,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:09 UTC)" (scheduled at 2021-11-08 15:37:09.376681+00:00) notificationworker stdout | 2021-11-08 15:37:09,377 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:09 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:37:10,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:20 UTC)" (scheduled at 2021-11-08 15:37:10.322052+00:00) notificationworker stdout | 2021-11-08 15:37:10,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:20 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:37:10 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.018 1690 0.018) gunicorn-registry stdout | 2021-11-08 15:37:10,984 [230] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:37:10 +0000] "GET /v2/c17744/test_custom/manifests/10.2.25.00-DEV-corecustom-sp9-051121134804 HTTP/1.1" 404 82 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" repositorygcworker stdout | 2021-11-08 15:37:16,906 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:16 UTC)" (scheduled at 2021-11-08 15:37:16.905627+00:00) repositorygcworker stdout | 2021-11-08 15:37:16,906 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:16 UTC)" executed successfully securityworker stdout | 2021-11-08 15:37:17,787 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:47 UTC)" (scheduled at 2021-11-08 15:37:17.787050+00:00) securityworker stdout | 2021-11-08 15:37:17,816 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 191-231 securityworker stdout | 2021-11-08 15:37:17,819 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 268-308 securityworker stdout | 2021-11-08 15:37:17,821 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 231-271 securityworker stdout | 2021-11-08 15:37:17,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 394-434 securityworker stdout | 2021-11-08 15:37:17,827 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 143-183 securityworker stdout | 2021-11-08 15:37:17,829 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 345-385 securityworker stdout | 2021-11-08 15:37:17,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 103-143 securityworker stdout | 2021-11-08 15:37:17,833 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 308-348 securityworker stdout | 2021-11-08 15:37:17,835 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 385-425 securityworker stdout | 2021-11-08 15:37:17,838 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 183-223 securityworker stdout | 2021-11-08 15:37:17,841 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 434-464 securityworker stdout | 2021-11-08 15:37:17,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 6-46 securityworker stdout | 2021-11-08 15:37:17,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:37:17,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 47-87 securityworker stdout | 2021-11-08 15:37:17,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 46-86 securityworker stdout | 2021-11-08 15:37:17,856 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 87-127 securityworker stdout | 2021-11-08 15:37:17,856 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:37:17,859 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 64-104 securityworker stdout | 2021-11-08 15:37:17,862 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 21-61 securityworker stdout | 2021-11-08 15:37:17,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:37:17,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 170-210 securityworker stdout | 2021-11-08 15:37:17,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 61-101 securityworker stdout | 2021-11-08 15:37:17,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 293-333 securityworker stdout | 2021-11-08 15:37:17,874 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 15:37:17,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 254-294 securityworker stdout | 2021-11-08 15:37:17,879 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 116-156 securityworker stdout | 2021-11-08 15:37:17,881 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 156-196 securityworker stdout | 2021-11-08 15:37:17,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 104-144 securityworker stdout | 2021-11-08 15:37:17,886 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 210-250 securityworker stdout | 2021-11-08 15:37:17,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:37:17,891 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 448-464 securityworker stdout | 2021-11-08 15:37:17,893 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 339-379 securityworker stdout | 2021-11-08 15:37:17,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 333-373 securityworker stdout | 2021-11-08 15:37:17,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 379-419 securityworker stdout | 2021-11-08 15:37:17,898 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:37:17,906 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block notificationworker stdout | 2021-11-08 15:37:20,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:30 UTC)" (scheduled at 2021-11-08 15:37:20.322052+00:00) notificationworker stdout | 2021-11-08 15:37:20,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:30 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:37:21,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:51 UTC)" (scheduled at 2021-11-08 15:37:21.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:37:21,810 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:51 UTC)" executed successfully gcworker stdout | 2021-11-08 15:37:22,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:52 UTC)" (scheduled at 2021-11-08 15:37:22.617060+00:00) gcworker stdout | 2021-11-08 15:37:22,637 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:52 UTC)" executed successfully securityworker stdout | 2021-11-08 15:37:23,813 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:37:23,813 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:37:23,814 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:37:47 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:37:27,885 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:27 UTC)" (scheduled at 2021-11-08 15:37:27.884604+00:00) namespacegcworker stdout | 2021-11-08 15:37:27,900 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:27 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:37:30,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:40 UTC)" (scheduled at 2021-11-08 15:37:30.322052+00:00) notificationworker stdout | 2021-11-08 15:37:30,336 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:40 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:37:40,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:50 UTC)" (scheduled at 2021-11-08 15:37:40.322052+00:00) notificationworker stdout | 2021-11-08 15:37:40,338 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:37:50 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:37:46,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:42:46 UTC)" (scheduled at 2021-11-08 15:37:46.131205+00:00) namespacegcworker stdout | 2021-11-08 15:37:46,149 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:42:46 UTC)" executed successfully securityworker stdout | 2021-11-08 15:37:47,788 [102] [INFO] [apscheduler.executors.default] Running job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:38:17 UTC)" (scheduled at 2021-11-08 15:37:47.787050+00:00) securityworker stdout | 2021-11-08 15:37:47,813 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 174-214 securityworker stdout | 2021-11-08 15:37:47,818 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 16-56 securityworker stdout | 2021-11-08 15:37:47,822 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 100-140 securityworker stdout | 2021-11-08 15:37:47,824 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 140-180 securityworker stdout | 2021-11-08 15:37:47,828 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 57-97 securityworker stdout | 2021-11-08 15:37:47,831 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 97-137 securityworker stdout | 2021-11-08 15:37:47,834 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 56-96 securityworker stdout | 2021-11-08 15:37:47,837 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:37:47,840 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 280-320 securityworker stdout | 2021-11-08 15:37:47,844 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 220-260 securityworker stdout | 2021-11-08 15:37:47,846 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 260-300 securityworker stdout | 2021-11-08 15:37:47,849 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 214-254 securityworker stdout | 2021-11-08 15:37:47,851 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 389-429 securityworker stdout | 2021-11-08 15:37:47,853 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 326-366 securityworker stdout | 2021-11-08 15:37:47,855 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 366-406 securityworker stdout | 2021-11-08 15:37:47,858 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 320-360 securityworker stdout | 2021-11-08 15:37:47,860 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 429-464 securityworker stdout | 2021-11-08 15:37:47,860 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:37:47,864 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 368-408 securityworker stdout | 2021-11-08 15:37:47,866 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 422-462 securityworker stdout | 2021-11-08 15:37:47,869 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 408-448 securityworker stdout | 2021-11-08 15:37:47,871 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 462-464 securityworker stdout | 2021-11-08 15:37:47,873 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 270-310 securityworker stdout | 2021-11-08 15:37:47,876 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 35-75 securityworker stdout | 2021-11-08 15:37:47,878 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 1-41 securityworker stdout | 2021-11-08 15:37:47,882 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 320-360 securityworker stdout | 2021-11-08 15:37:47,884 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 310-350 securityworker stdout | 2021-11-08 15:37:47,887 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 360-400 securityworker stdout | 2021-11-08 15:37:47,889 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 92-132 securityworker stdout | 2021-11-08 15:37:47,892 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 75-115 securityworker stdout | 2021-11-08 15:37:47,895 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 207-247 securityworker stdout | 2021-11-08 15:37:47,898 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 132-172 securityworker stdout | 2021-11-08 15:37:47,900 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 172-212 securityworker stdout | 2021-11-08 15:37:47,902 [102] [INFO] [util.migrate.allocator] No candidates, marking entire block completed 247-287 securityworker stdout | 2021-11-08 15:37:47,903 [102] [INFO] [util.migrate.allocator] No more work securityworker stdout | 2021-11-08 15:37:47,917 [102] [INFO] [util.migrate.allocator] Found 40 candidates, processing block securityworker stdout | 2021-11-08 15:37:49,208 [102] [ERROR] [util.secscan.v4.api] Security scanner endpoint responded with non-200 HTTP status code: 500 securityworker stdout | NoneType: None securityworker stdout | 2021-11-08 15:37:49,209 [102] [ERROR] [data.secscan_model.secscan_v4_model] Failed to perform indexing, security scanner API error securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 204, in index securityworker stdout | resp = self._perform(actions["Index"](body)) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 296, in _perform securityworker stdout | raise Non200ResponseException(resp) securityworker stdout | util.secscan.v4.api.Non200ResponseException securityworker stdout | During handling of the above exception, another exception occurred: securityworker stdout | Traceback (most recent call last): securityworker stdout | File "/quay-registry/data/secscan_model/secscan_v4_model.py", line 288, in perform_indexing securityworker stdout | (report, state) = self._secscan_api.index(manifest, layers) securityworker stdout | File "/quay-registry/util/secscan/v4/api.py", line 208, in index securityworker stdout | raise APIRequestFailure(ex) securityworker stdout | util.secscan.v4.api.APIRequestFailure securityworker stdout | 2021-11-08 15:37:49,209 [102] [INFO] [apscheduler.executors.default] Job "SecurityWorker._index_in_scanner (trigger: interval[0:00:30], next run at: 2021-11-08 15:38:17 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:37:50,322 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:38:00 UTC)" (scheduled at 2021-11-08 15:37:50.322052+00:00) notificationworker stdout | 2021-11-08 15:37:50,339 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:38:00 UTC)" executed successfully exportactionlogsworker stdout | 2021-11-08 15:37:50,395 [68] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:50 UTC)" (scheduled at 2021-11-08 15:37:50.393684+00:00) exportactionlogsworker stdout | 2021-11-08 15:37:50,409 [68] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:50 UTC)" executed successfully buildlogsarchiver stdout | 2021-11-08 15:37:51,794 [64] [INFO] [apscheduler.executors.default] Running job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:38:21 UTC)" (scheduled at 2021-11-08 15:37:51.793811+00:00) buildlogsarchiver stdout | 2021-11-08 15:37:51,807 [64] [INFO] [apscheduler.executors.default] Job "ArchiveBuildLogsWorker._archive_redis_buildlogs (trigger: interval[0:00:30], next run at: 2021-11-08 15:38:21 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:37:52,377 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:42:52 UTC)" (scheduled at 2021-11-08 15:37:52.376404+00:00) notificationworker stdout | 2021-11-08 15:37:52,395 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.update_queue_metrics (trigger: interval[0:05:00], next run at: 2021-11-08 15:42:52 UTC)" executed successfully gcworker stdout | 2021-11-08 15:37:52,618 [69] [INFO] [apscheduler.executors.default] Running job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:38:22 UTC)" (scheduled at 2021-11-08 15:37:52.617060+00:00) gcworker stdout | 2021-11-08 15:37:52,634 [69] [INFO] [apscheduler.executors.default] Job "GarbageCollectionWorker._garbage_collection_repos (trigger: interval[0:00:30], next run at: 2021-11-08 15:38:22 UTC)" executed successfully repositorygcworker stdout | 2021-11-08 15:37:54,169 [100] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:54 UTC)" (scheduled at 2021-11-08 15:37:54.169080+00:00) repositorygcworker stdout | 2021-11-08 15:37:54,183 [100] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:54 UTC)" executed successfully namespacegcworker stdout | 2021-11-08 15:37:55,132 [81] [INFO] [apscheduler.executors.default] Running job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:55 UTC)" (scheduled at 2021-11-08 15:37:55.131477+00:00) namespacegcworker stdout | 2021-11-08 15:37:55,132 [81] [INFO] [apscheduler.executors.default] Job "QueueWorker.run_watchdog (trigger: interval[0:01:00], next run at: 2021-11-08 15:38:55 UTC)" executed successfully notificationworker stdout | 2021-11-08 15:38:00,323 [85] [INFO] [apscheduler.executors.default] Running job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:38:10 UTC)" (scheduled at 2021-11-08 15:38:00.322052+00:00) notificationworker stdout | 2021-11-08 15:38:00,337 [85] [INFO] [apscheduler.executors.default] Job "QueueWorker.poll_queue (trigger: interval[0:00:10], next run at: 2021-11-08 15:38:10 UTC)" executed successfully nginx stdout | 10.100.102.3 () - - [08/Nov/2021:15:38:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64" (0.003 228 0.003) gunicorn-registry stdout | 2021-11-08 15:38:00,393 [240] [INFO] [gunicorn.access] 10.100.102.3 - - [08/Nov/2021:15:38:00 +0000] "GET /v2/ HTTP/1.1" 401 4 "-" "cri-o/1.20.2-3.rhaos4.7.gitfecc319.el8 go/go1.15.5 os/linux arch/amd64"